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.projects. An individual set of objectives was, determined for each 
trainee. Learning activities, . including group dvents, guided 
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prescribed on the basis of the trainee's objectives. The results 
indicate that the training model is effective, efficient, and , 

. app>ealing to both employejss and- trainees. Tt is' concluded that the 
model can be of u^e in independent training programs, as an adjunch: 

» to regular academic prog.rdms’,||pr for inservice training i It is also 
an example of how unemployed* prdf ess ibnals may be cross-train ed £jxc • a 
: new- field. (Author) . ’ ... ^ 
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The goal of this project is. to develop, pilot test, and document a new- 
model for trafning personnel, for educational research and development^. ^ 
The model provides .short-^erm training’ in applied research and develop- 
ment for persons with B./© and M.A. degrees. It features individualized, 
learning and "real-time" expierience on actual R&D projects. The modef 
developed Cjan be of uSe in independent trainingj, programs., as an adjunct 
to regular academic programs, or for in-service training. It is also an 
example of how unemployed professionals' may be cross-traiped fojh a new 
f^i-eld in whi.ch their skills'are in demand. A manual ^submitt^ with the 
final report -prescribes procedurjes and materials for conducting a' train-* 
ing program based on the model dev.eloped„in. this project. . - . 

The training model was-pilot tested with six unemployed physical scientists. 
Uuri ng the three-month program trainees spent approximately half of their 
time studyihg topics and problems in edc^ation, and half of their time- 
working as apprentices on R&D proj*ects.-/ An- individual set of .objectives ’ 
was determined for each trainee. Learning activities, including group 
events, guided independent study, and apprenticeship tasks, weVe then 
individually ’prescribed oh the basis of the traijaee^'s^objectives. Evi- 
dence from thd pilot- test suggests that’ the training model is effective, 
efficient, ^and appealing to both employers, and trainees. 
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In the coming decades the need for quality personnel at all ..levels in the 
field .of educational resear£h apd development wil 1 be critical. This pro- 
ject d'ealS' With that emerging need. A new training' model- has been devel-- - 
oped, , pilot tested, and_ documented. , It may be employed either to* improve • 
the skills of fhose alreacly working in tl^ field,, or to train new people 
fqr the field. < 



Tl^e heed for personnel in educational^ research, and .development has been pro- 
jected in a number of^studies. In.^a ’l969 study, l!:Tark an^ Hopkins proposed 
three different estimates of potential growth in the field between 1964 and 
1974. Current economi.c Conditions suggest that their lowest estimate will 
pri^e correct.' This,! low estimate, however, calls for a three-fold increase 
.in personnel • requirements during the.peripd..,- Any shortage in the supply 
^ . will result in insufficiently^trained personnel filling positions. , In a : 

still more recent study, conducted after the -advent of the economic slowdown, 
Fleury, Cappel luzzo, and Wolf .(197.0) al.so,/'predict a shortage of trained" ' ^ 

'personnel..- Their analysis • suggests that current programs supply personnel ^ 

, dnly for conventional university Iqvel research positions .. .Almost no train- 
ing is available tp meet a growing demand in a|5plied work fncludihg develop- 
ment and evaluation. . Furthermore, current training focuses on the' doctoral • 
level, while evidence indicates a growing needfor personnel at other levels ^ 
.also. . , . ^ , J ^ 

_ '' / ' . 1 V ' ' 

• . Far West Labdratpry (Hood et.al . , '1971 )' conducted a, sju rvey of employers in - 
, the San Francisca Bay area.. The Sum of tlje ’project’ecj “need fgr new personnel 
came to 255 in }971-1972’41,one. Mbst of the positions were dredicted -*8^0 
• require the B. A. dr M. A. degrees. The^ report also cdricludea that Claris. and 
' • Hopkins' low estimate was, probably ^rrpet, .but too narrow in scope. . I%r West . 
predicts an additi”dhal '•demari^i tor'll ) professionals from industries not 
- V.strictly defined in the educational -development area, and 2) paraprofessiqnals . 
In general, a shdrtage of quality personnel in education^i^esearch andode- . 
-velopment would pr^errt a serious. obstacle to the progress' So critically • 
needed ,in the field. ’ ' ’ 

» For tf^ most part^icurrent training'-'emp^oys -(Classroom techniques'^,, emphasizes 
doctoral degrees in pure research, and requires *^sevprar years- for completion,^ 
Internship components' are usually part-t^e and highly artificial. There is 
a real need for a new model whicij^will provide effective short tferm training 
in’ applied researc|>*and development. The need for training efficiency 
suggests that the model should provide in^vidualtzed learning and realtime ^ . 
experience on actual projects in educational research and development. The 
model must be maxima ij^attractive to both trainees and hostjp^'ganiz-etions. 



u 



. While researchers speculate ^out a possible shortage* of personnel in edu- 
cational research and deve^opiirent, a great. surplus .of personnel in the 
physical sciences exi'^s. Unejnpl oyment in’ the physi'caV sciences is a problem 
to Which this project also speaks'. More than 65,000 engineers were unemployed 
in April of 197.1 dnd' that number was 'expected t6 increase as the year pro- 
gressed (Gobding, 19710., Such inemploymerit results, in a Wa*ste of talerht and 
a good deal of personal, hardship. 
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General , Approach and Ra^’onale 







, The .goal of this pro jecd: is to .develop a new model for training personnel • 
in educational research and development. The, project explores the mooel's* 
application to the problem^ 6f. cross training unemployed physical scientists 
for. work in educational' -RSD. The program aims to' crb'ss train rather than 
train or retrain: Cross training may be defined as a. process in'*which stu,- 

de/its are .taught to apply their ex is ting sjsills to new situations. Trans- 
fer o,f skills, ratbei!^ than the teachingSf new skills, is emphasized. 
Physical scientists are* skilll’d in useful analytical and empirical a,p- / 
proache's to problem solving. They may bring new skills(san.d new' points of^, 
view ta educational problems. They represent a potential source not pnly 
of competent professioiial ^rk, but,, of creative innovation. 



The training model can best be 'described as apprenticeship work-study Trainees 
spend approximately half of their time studying topics and problems in educa- 
tion and half of tbeir time working on actual R&D projects.. Important features 
of the model are that it . is short term; it emphasizes the transfer of /existing 
skills; it is individualized; and it includes apprenticeship work. •- • 

. • * . X i , 

' \ •* ‘ r 

Althougfi most training is nob individualized, indi^/idualization is clearly 



recognized as a desirable component f^r. all instruction, ^Generalities 
need not.be d-iscussed here. Several ‘reasons behind the particular importance 
of individualization to this model should be mentioned, however.' 1) Becaiice 
the program airts to apply .the existing s\i'l Is of participants, special atten^' . 
tion must be given to the particular skil Is each,, ii^idiyi’dua’l has. .2) Because .'.,- 
the program calls for sViOrt term, efficient .braining, instruction .must be 
tailored to'the learning strengths- and objectives of each- individual . 

' ' ’ ^ ■ ■ o •' . . 

The apprenticeship’ compontent” is ‘valuable, for .the 'following reasons^-ij.)‘ It 
allows the trainee to’ immediately begin applyi-ng his existing skills in the 
new context of educational R&bV 2) It provides a framework for the academic 
work; Tt highlights ,tlie^ relevancy of the studies, and thus adds to the 
trainee's motivation. '3) It permits a trainee to refine°and develop his .. 
^career objectives .in the light of real experience. T4) It promotes rapid 
learrvrng. - 
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Objectives of ^Project 
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The central objective of the project, is to develop' and pilot" test an^iipiyren- 
ticeship .work-stud^ model. T.he model mus't be one which can "be -exported^ and ^ 
duplicated. Withi'n this broad-^objecti ve, the project aims to develop and. •’ 
define: ' . 

k. 

1. procedures _and. materials 'fSV' 



^ . 



\ 



L. . 



an oflxiine of the cdfriculum, 



managing the instructional system, 

1 . ' ^ ■ 
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3. procedures for arranging and. managing apprenticeship positions, 

a j " 3 ^ * 

4. procedures for recruitment, selection, and a trainee support system, 

. 5. procedures for assisting trainees to secure jobs in educa.tiona.l R&D. 

■ • • ■ ' ' i , 

From, thQ. point of view, of th,e trainees, the objective of the . ti^aitning program 
model itself, is to make them employable in the field of educational RM). ' 
Toward this goal V the trainees will be given the opportunity to;' 

- Study ^educational R&D, ' z ' . 

. \ ... - ' , . 

.. yj-; analyze the' interests and, skills they now possess which are- 
-i-'^ppli cable to ed|catl6nal R&D, 

- establisli, with professional ''^assistance, a personal set of 

learning objectives, • . . *• 

- pursue the development of the;-additional skills "and khowledge‘ . 

required to;meet the new “career goals' they establish fori 
themselves, ' . ' 

■ - o “ ■ . r,; . ' 

- acquire "real-time" experience through supervised apprenticeships 

on^actual R&D projects, • .. ^ 

" • • . ' ■ ' ' 1 . S 

- take advantage, of job leads and contacts provided by th'e program.- ' 






\ ■ 



'<2i 






\ 



as- 



i’:- ■ 

Mr- 



r • 

ERLC 












- 3 - X 



i , ^■.8 

<g • •- 



,r 



. ... 



• v 



Ah Overview of the Model 
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. Length of proqram- TAljproximately thre^ months, but flexible, ' 

• ' * * • 

Site— An. educational' research and development organization. / 

Target population- -Flfexible,.- Program may be targeted for ,in-servi.ce' 
trainees, for s^tudehts, or for other j>ersons, wishing to enter the 
field of educfitional R&D, In this pilot test, i^nemployed physical 
scientists wishing to -transfer to educational R&D were selected,'' 

' i ■ * 

Instructional s.ys tern- - Individualized program of studies for each trainee 
based on a set of ..persona i instructional .objectives. 

Curriculum- -Learninq 'theory. Instructio1lin\ methods and materials. . % 
Evaluation and evaliiatio.n models./ Measuremei^nt.' Educational' 
statistics, Legal, social and political -aspects- of .education.. 

Proposal Vitriting. Comparative tap analysis' between physical science 
^nd educational J^&D. Employment Dossibilities. , • • > • 

. RecKuitmejit procedures- '-Depends on'rarbet population. The pilot test used 
a- .clarified advertisement, a.presjs *heleasdr, and state unemployment 

• agencies. Application stages included submission of a resume and ^ 

information sheet, written tests, and an interview. ' > ' ’ 

> ■ . ■» - ' . ■ . . 

•Selection criteria — Evidence of iiTterest in education* " Exj^stence of 

specific personal career objectives .in education. Existence of skills 
\pseful- in education. - Reasonable salary expectations. Evidence of, 
success in college and employirfent. . •, .‘ 

Stipend- -Dependinq pn the target population the program may 'or may not ^ 

include a 'trainee stipend.," The plot. test included. a living expense^ 
stipend of $75 .per week plus $l?^per week per dependent. . - . 

Ass^'stance with->job placement— Assistance irp locating openings and applying 
-frfiploymeht " ^ 



for jobs. ’€rfiploymelit recommendati ons 
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.'.THB INSTRUCTIONAL MODEL 
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This chapter is dividexi into three basic .sections. The first section is 
an outline of the curriculum.'. The second section describes the instruc- 
tional systefn. It includes information on how individual trainees objec- 
tives were determined, how learning activities \w6re prescribed, and how 
trainee .progress was monitored. The’ third section describes the appren- 
ticeship component ^f the'mbdel. It fnojudes vnfoKmation on the kinds of 
apprenticeship- tasks performed,* and how they were selected, assigned, an"" 
monitored. \ , 
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Outline Of Curriculum 
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The cross -trailing 'model features>vin^ivi dualized instruction'. Trainees were- 
given assj’stance in selecting a sdt dt individual objectives^. The.y.then 
participated in learning activities which helped them meet these ‘Ob'jecti ves . 
tKs individual .pro'gVess of eath traine|e was monitored. Leading, activities 
included 'the apprenticeship, guided independent ^tudy, and grpup- Instruction. 
This section isvdevoted to the' content or curriculum^withTn this instruc-' 
tional system. -Specifically,' it focuses on the xqntent of the gfoup . . 

instruction and the guided independent' sfudy. The content' of the, apprenttce- 
;Ship is further discyssed in anothe'r section, y Vo 

The instructional objectives define the'overajreurriculum of .the prog»V»n- 
Appendix A contains. a list of the 130 insfructional objectives -used in this 
program. A variety o'f sources were' consulted in the development of ob- 



jectives including materials produced by the. Far West £onsortium\for DD&E • 

tb ■ ' 



I" 



training. Objectives are organu-ed into the -following skill categories: 

library skif'^s, 

-* instrumentation, 
x'- data Collection,' 
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- data anal.ysis , . 

- proposal ‘prepai^atio^n , 

A 

- product development, 

- evaluation; 
marketing, 'dissemination, 

- -implementation, 

- AV rite -up and publication,' 

- scheduHng^and meigagement 






At the beginning of the program a la^ge amount of time was spent in group' 
acti vi ties^ 'and assighments > As the program progressed, howeVer, trainees bfegaor, 
to spend more tinie in individual activities. ' ' . j 









Group Activitip ° . • 

feroup acti vi ties, and assignments dur^ig the program are shown in Appendix 
Activities .included lectures, seminars, reading assignments, films, fTeld 
arid other activities. Lecture and semi nar -topi cs included, the following: 

. - Irjtrpduction to and overview of the cross training 
? program (Millstein) " • • . • 

- Overvil^ of educati onal research and development (Melnotte) . 

'r' • ■ • ■ ) ' 

’ ' Suimriary of .educational R&D projects curi^ently being 



B.. 

trips , 






inducted at AIR (Melnotte)' 



\ 



,\ 



\ 



■- AIR in the^broader context of educational R&D (Dunn) 

'■ A, - 

- Future role of education R&D and AIR's objectives (Tiedeman) 

■ ‘ ■ • f '• ■''\ ' 

- Kinds of apprenticeship po’sitions available (Millstein) 

- General skills' jnvolveci^jij.^du.c3tionaj R&D (Dunn)’. 
-'Developing instructional materials ^(Steel ) 

- Behavioral (object! ves (Millstein) ' , ; ” 

- Programmed .instruction (Millstein) -s. ^ ' 



- Computer-assisted instruction (Millstein) 

. - Incentives and accountability (Jung) 

- Data collection with young children (Dunn) 

- Behavior modification ^(Lipe) • 



- Proposal evaluation (Ausloos) 

- Job search strategies (Millstein) 







More than fifteen books "and journal articles were designatetl as assigned 
reading for everyone in the group during this program. Assignments.; were 
selected to prepare trainees for the seminars and lectures. Titles are 
detailed in. Appendix B. In^ addition to reading, assignments ccilTed for 
activities such as solving educational statistics problems or writing a set 
" of behavioraT objecti ves . • . | 

Several films, appropriate to the seminar topics, were shown. They included; 

* , 

D. Mark le r Pro^ammed Instruction: The DeveJop.mental Process 

J. Harris', Project CVIS ' . \ 

AIR, P^oject PL#1 ' • ' . ^ • 

J. Diinn, Data Cbl lection wi th Young Childrea -: ^ 

An excellent source/for assistance in the selection of appropriate films is 
Schneider, Ji. M.;" Barnett, A.; and Addis, M. films in the Behavioral Sciences: 
an Annotated Catalogue The catalogue contains descriptions of approximately 
1300 filrns. They are'^organized both by titTe aiid subject .area 

Trainees participated iii two field trips — one to the Brentwood school, an 
innovative school in a blaclc neighborhood, and t’^e^ither to Educational Testing 
Service., Both events featured intensive round tab:je discussions'^ wi th repre- 
sentatives of the institutions. Trainees also attended a 2-day professional 
conference on guidance. . . i ' 



Group activities may be further described by presenting several examples in 
more detail. The prescribed activities for studying behavioral objectives 
will serve as a general example., Trainees ‘Vead" Mager' s book Preparing In- 
structional Objectives . They wrote\three behavioral objectives in a subject 
of their own cn’oosing. They- then reviewed the behavioral, objectives spe- 
cified in Project PLAN, selected five Well-written objectives and five poorjy 
written objectives, and explained the reasons behind thejr selection. The ' 
assignments Were checked individually. , Tra'iipees whp, ^perienced diffi'cult/ 
writing objectives were asked to write more. Ea,ch.,t.ra'inee was expected to 
demonstrate mastpry of the basic concepts. Neaf the close of the'day trainees 
participated in an hour seminar on behavioral objectives. As a team, they 
tackled a probldm more difficult than/the individual assighmeilts worked on , 
earl in the day. • . 
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The events on October 1 exemplify a different kind of group- acti vi ty . The . 
morning consisted of a field trip'-fo the Brentwood Sqhool - a pCiblid elementary 
.school in a black neighborhood. 'It features, innovative instructional procedures 
and a' sophisti cated computer-assisted instruction system. The early part of the 
mofnin^. was spent in a round tabl^ discussi on with Brentwood's principal and 
three teachers. The discission centered on skills that physical scientists have 
which are relevant to,/edtsational problems in the Brentwood^schooV and sf.hodlt. 
like it. Next trainees>were given a tour of the computer-assiste.d instruction 
system. whi le it was being used by the elementary sc+iool students. Trainees also 
had the opportunity to sit at a co^mputer terminal and experiment with' this 'mode 
of instruction. In the afternoon a lecture-seminar was held at AIRion 
computer-assisted instruction. Discussion focused on special advantages and 
1 imitations .of the technique". This was followed by a presentation for those 
interested in the more technical aspects of C.A.I. including an overview of 
the computer language and a review of cost factors. 



V 






A third kind Of exp^r^ience i^^exemplified by ‘activi ties^n October 7 and 8. 

On these days AIR hosted thexighth Invitational Conference on Systems Under 
Construction for (Career Education^and Development. Paoers presented at the 
conference fell. into two categories:' 1) models for career education and 2) 
reports on the" statuss and progress ,of various guidance systems. Trainees 
attended all ’sessions of the conference. It provided the opportunity to review 
the most rec^tvaccomplishhients in the field, to meet professi onals 'i n the field, 
and to witnessfjjrofessional customs and' modes of ope^ati ng't’ 












Guided Independent Study 



no 



Individual^ study was intense. Taken all, together trainees read morei_than 
different journal arti cles and books 'In addition to reading, activities 
included writing papers and discussing educational issues with AIR professionals. 
Individual areas of interest ranged from philosophical investigations of the 
process of' thinking to cost effectiveness in schools. The guided independent 
study engaged in by each trainee is^detai led in Appendix C. 



7s 



As an example of ^n independent study project, one trainee wrote a 2T-page 
position paper on hi hypothesis that school .curriculum must be changed to 
put heavier emphasis on the development.,of p/oblem solving skills, .In order 
to write the paper he reexamined and studied works by Dev/ey, Shaw, Oettinger, 
Coleman, Simon, Berg, Hebb, and Bloom. l ' 



•> 



-As another fi^mpTe of an. individual activity,' one of the trainees attended 
;the U.S.O.E'., Region 9, small grants review panel in Reno, Nevada. .He was 
■thus given the opportunity to study the criteria and procedures whereby 
U.S.oJE^ fund^mal 1 grants in educational research. Upon his retu»*h,.he 
condtlcfed^^^u-l^cture-seminar for the other trainees on this topic. 
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InstrujCtional Materials and Resources 




A list of instructional materials and resou/'ces, is shown in Appendix D. The 
list contains basic. works relevant to all trainees and more specific works 
relevant to the individual objectives of trainees in the program'. 



Consideration was given to the use of three sets of materials cufrently being, 
dev^oped to train personnel for educational research and development. Mate-^ 

■ rials are being developed independently by Eva Baker at U.C.L.A., George Cropper 
at American Institutes for Research in Pittsburgh, and the Far West cinsortium 
for Development,- Dissemination, and Evaluation Training.’ A decision, based 
•primarily on immediate availability^and convenience ofuse, was made to use 
some of the Far West materials. V ' . - 

When completed, the Far West Consortium program will contain materials for 
maters. level courses in information/data collection and organization, comriu- 
iTication skills, planning and design, developmental engineering, evaluation, 
dissemination marketing, analysis and definition, -and management. Few of tiiese 
materials were ready for use during the cross-training program. Several modules 
in the information/data collection and organization course were used extensively, 
however. Five of the six trainees studied the modules Data Collection and 
Data Analysis .. Because these modules were in the development stage ,-’the trainees 
had the opportunity tp participate in their improvement and revision. After 
studying the modules, they prepared as a team a set of proposed improvements. 
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EXiC 

■hiMHiirnffTikiia 



General Comnffents on the Cifrricu.lum 

In order to meet the requirements of individualization, the curriculum should • • 
be a fluid resource rather than a fixed one. It should constantly expand and 
change to meet the needs of trainees enrolled in the program. Objectives ^ 
will vary in importance depending on the individual interests and goals of 
the students. The curriculum must be fluid enough to accommodate these vari- 
ations. If -possible, there should be a variety of resources appropriate to 
each of’the o.bjectives. 

. Every ^program should result in an addition to the curriculum materials 
base. .^This should be the natural result of programs which cater to individ- 
ual interests and goals in the context of a field which cons.tantly changes 
and progresses. / . ^ 

As an interesting side point, it was found that materials and reports produced 
by the host institution as part of their regular R&D activity were particular- 
ly effective for curriculum use. Professionals ut the host institution had ^ 
special knowledge -about these works and consequently communicated a particular . 
enthusiasm and interest. ^ 

V 

In general, the curriculum base outlined in this chapter proved to be an* effective 
resource. Materials were provided which were relevant' to trainee interests, 
goals-, arid work. The curriculum may also be easily a'dapted for use with future 
crdss-traiining programs. Almost all materials are readily available. It will 
be necessary, however, for any host institution to have a library or very easy- 
access to one. AIR has an extensive library in. the fields of psychology and 
education plus access to all Stanford University libraries. 



Instructional System 



h 

Overview 

The instructional system was established to perform three basic functions. - • 

- ASj^ist the- trainees in determining an individual set of objectives. 

- Prescribe learning activities -- including group activities', V 

guided independent studies, and apprenticeships -- which will 

help trainees meet their individual objectives. ' • 

- Monitor trainee progress toward his objectives.. Help him re- , 
define and focus his objectives. Prescribe further learning “ 
activities on the basis of these redefined objectives. 

The system was maintained by an instructional manager, in this case the project 
director, who worked closely and individually with each of the trainees to 
insure that the three functions were performed. 

I i ■ . 

Determining Individual Objectives ^ 

The array of objectives provided in the program has already been described 
in the Outline of the Curriculum^ and in Appendix A. It is the use of these ' 
objectives which is pf concern in this section. 

The list of objectives provided the trainees with an overview of the different . 
j^kill areas in educational research and development. It' served as a general 
framework to which all study could be related., . ; “ 






At the outset of the program, trainees were understand&bly unprepared to 
select a very specific set of objectives. They' were new to the field, and 
their knowledge of what the different areas of educational R&D involve was 
hazy.' Personal goals at this time usually involved s*ampli,ng many of the areas 
in order to achieve a more comprehensive view of the field. As the program/ 
progressed, trainees were able to select rhore specific objectives. / 



were abbibueu m vnc i r :>e leuu luii. ui uujculivc:> in uwu majui wajo. 

the instructional manager met individually with eacfTaf the trainees > 
iscuss the individual's general goals and interests aruHiis educational and 



The trainees were assisted in their selection. of objectiv^ in two major w^ys. 
First, 
to di: 

employment background. From this discussion an attemp^^as made to estab^lish 
a set of appropriate objectives. As the program progressed, periodic meetings 
with the instructional manager led toj^finement and focus in this set of • 
objectives. . ^ j 

Second, each trainee was' asf.ed to study the list of objectives already described 
and shown in Appendix A. For each objective ha was to note one of the /following: 



1) could do before program, 

2) acquired during firogram. 



r 



. 3) cannot do, 

4) if "can do," note degree of expertise, 

a) slight, 

. b) moderate,, 
c) strong, 

5) would like to emphaJ:ize in balance of program 




# 



This exercise was repeated during the program to assist the trainee j m the 
refinement of his personal set* o^ objectives. ' . ' 

Trainees were able to refine their set of objectives because of their experi- 
ence ih'the program. As they worked on apprenticeship projects, andlas they 
spdke with various AIR professionals, their understanding of the field became’ 
deeper and they were thus better able to assess their own interests and abilifies* 
vis a vis educational R&D. ' , 



Prescribing Learning Activities . ’ 

Based upon the individual set of objectives of-each trainee, a set of learnwig 
activities was prescribed. The actual learning activities -- group activities, 
independent studies, and apprenticeships -- are described in the sections op ^ 

.the Curriculum and the Apprenticeship. It should be noted, however, that these 
activities were suggested in response to individual objectives. For example",' 
one'of the traineesiwas particularly interested in proposal writing and sources 
of funds. In order to help meet his objectives in this ared:, he attended the 
U.S.O.E. small grants review panel. This activity has previously been described. 
Another trainee, interested in deepening his understanding, ,pf curriculum 
development, wrote a paper on the need for emphasis on proBTem solving skills 
in the curriculum. Many of the group activities, including the seminars and 
field trips were scheduled because they were appropriate to objectives' specified 
by almost all of the trainees. Group activities were far more frequent during 
the first half . of the program' because most of the trainees were then interested 
in sampling .the various areas of educatio'nal R&D. 

One of the instructional manager's most critical 1:asks is thV prescription 
of learning activities in response to individual objectives. The instruc- 
tional manager must be familiar with the I iterature in educational R&D.^ He 
must also be familiar with the. people and resources in the host institution, -• 
and in institutions in the surrounding area. In this way he will be able 
to prescribe learning activities appropriate to varied sets of objectives. 

In situations in which' the instructional manager lacks the required knowledge 
of a specific area, he should draw upon the knowledge of colleagues at the ' 
institution. 

•rs ^ 

To prescribe a learning activity, the instructional manager should follow • 
these steps: 

1. 

2 . 

3. 



Consider the ih^ructional objective. 

Suggest an .appropriate learning activity to the'trainee. 

Discuss the activity with the trainee. Consider his reactions 
to the assignment. Outline a schedule for completion. 



The learning activities .described above and in the chapters on the curriculum 
and the apprenticeship fall into two categories:' 1) Many of these activities, 
are directly exportable to other educational R&D settings. They rely on 
nothing unique to the AIR environment; they'involve instructirfhal*materials, 
tests, filmSj etc. which are readily available. Other organizations adopting 
this model- will thus have. important segments of the curriculum specified. 

2) Some activities depend -on unique cohdi’tions. This program took advanj;age 
of the fact that B.F. Sj<inner happened to appear on educational televisidn 
and a professional conference on career education happened to r.cur at AIR 
during the training, program. 

In order to take advan,^age of this second type of activity, the instructional 
manager should be very alert to educational R&D events in the area. Professional 
conferences , important lectures , research facilities, model educational programs, 
all 'offer the^potentiar for rich learning activities responsive to specific 
/individual objectives. ^ 

Monitoring Trainee Progress 

.Tq insure effec^ve learning, careful monitoring of each trainee's progress 
was performed.' ' Monitoring- was accompllished in two ways — periodic individual 
meetings with trainees and weekly log^ submitted by trainees. Meetings between 
the .instructional manager and individual trainees took place twice a week. 
Meetings focused on progress to date, future objectives, and strategies for 
attaining these objectives. The instructional manager recommendd^d specific >■ 
objectives, suggested particular . learning activities, or alerted the trainee 
to Various AIR professionals working on project of interest to the trainee. 

The meeting was-also an opportunity for the trainee to make complaints or 
suggest improvements in the overall program.. 

In addition to these individual meetings, each trainee submitted a weekly log 
of his activities, progress, and reactions to various components of the program. 
This was ,a useful complement to the meeting^ because certain Individuals Are 
more expressive in written mode, others are more expressive' irfico,nversational 
mode. ' . ■ 

At the beginning of the program the format and general content of the log were 
left to the discretion of the trainee; As the program progressed, however, it 
was decided to provide trained with a specific format. This format called 
for the answering of the following questions: 

- Describe your apprenticeship activities. -- 

- Note any meetings you.ha\i with AIR staff members. Describe tfie 
gene’^al purpose of the meeting. 

- List your readings during the week. Note whether they were related 
to apprenticeship activities, independent study, or group activities. 

- Describe your job search activities. 

- Think about and list transfer skills and new skill you have which 
would be attractive to potential educational R&D employers. ^ 

Further comments 



/ 




r \ ^ 




'r. 





An example of the log format is shown in AppencMx E. In general, the logs 
provided a very effective" source of informatiojR on trainee progress and ^ 
attitudes. ' , . 




Information obtained In the logs was used in the individual meetings to help 
revise objectives and prescribe further leaii^ning activities. 

' General Comments Regarding the Instructional System 

The instructional\ system modell developed in this project provides a large < 

array of objectives and a large selection of learning materials, suggested ^ 
activities, etc. For operation the model does require an instructional manager' 
who understands the objectives and is familiar with the learning materials'. 
ij|he instructional manager should also be familiar with the people and resources 
6f the host institution and the educational R&D activities in the area. 

^ « \ 

The instructional manager does not teach in the traditional sense of the' word. ’X' 

Rather he performs three basic, functions. He assists trainees in .determining \ 
their individual objectives. He prescribes learning activities which help 
trainees meet their objectives. And he monitors the progress of these trainees 
in 'meeting their objectives. 

■ . - I 

In general, the system worked '^ell. Training was efficient and individualized". 
Demands on the instructional 'manager ' 5; tilne and abilities were quite rea'sonable. 

Several problems and issues^shouTd be mentioned, however. Guided independent 
study was an important component of the training. One problem was the difficulty 
of measuring student progress/ in thesQ activities. For ex^impie, suppose a 
trainee is interested in investigating research on the teaching of reading. 

Tovmeet these objectives he is assigned\to read Chall's book Learning to Read .. 
WherKhe completes this book, we have no ready method for measuring his under- 
standing- or progress toward his goal. Tests are certainly not available for 
measuring progress toward all the different obj^ectives. The problem was handled 
by having the instructional manager assess progress through his frequent meetings 
with the, trainee. This method, by itsellf, is an admittedly weak approach. There 
do not appear to be any more effective alternatives at the present time, however. 
It is certaihly not possible for the instructional, manager to design tests 'for 
all the different objectives trainees are wor'king on.\ This problem is not' 
unique to this training program. It is encountered^ i)^ most educational models. 

Perhaps the only real strain placed on the host institution wtfs in the presen- 
tation of lectures and seminars for the group instructional activities. Pre- 
paration time was frequently lengthy, and the cost of and strain on various 
employee's time became considerable. It should be mentioned, however,,, that 
the .lectures or seminars on projects in which the presenting staff members 
were enthusiastically involved were sometimes quite effective and even 
inspiring. 

Trainees differed considerably in their conscientiousness. It is believed that 
performance by the less conscientious trainees could be improved if a specific . 
incentive system were adopted. > As the program was structured, the only rea,! 
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external incentive was the prospect ot receiving a valuable job recommendation. - 
Several incentive systems have been considered for recommendation for future 
programs. A monetary incentive, say an increase in stipends at regular intervals,/ 
was considered undesirable for the following reason. ‘ The trainees are accustomed ’ 
to making a great deal more money than the' Stipend,. Rais-ing the stipend, even 
by a large percentage, will still seem rather- petty and is unlikely to cause 
(Ganges in trainee beihavior. \ ' 

An incentive system based on grades Sor^aluati on ratings is perhaps preferable. 
These ratings could.be made by the instructional manager and the apprenticeship 
^per\Tisor at regular periods, say once'every four weeks. The ratings would .. 
help trainees identify their weak and strong points. The ratings would have 
^incentive power because higher ratings would quite naturally lead to better job 
recommendations. Ratings must be handled in a dignified, CQnstruct’ilve manner. 



A 



Although occasion certainly , did not afrise in thfs program, future, larger scale, 
projectjs should probably ma-ke provision; for dropp-ing trainees from the -program 
if afte|r several weeks '^of training they appear entirely unsuitable. 
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The Apprenticeship 












Th,e apprenticeship was, probably the most important learning component of, this 
model. In order to fully describe its' role and function, this section is 
divided into six subsections: identifying potential apprenticeship. positions, 

selecting apprenticeship positions, monitoring apprenticeship^, external 
apgDrenticeship positions, descriptions of actual apprenticeships, and.’ ' 
conclusions. ' . ' 
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Identifying Potential Apprenticeship Positions 

For . tf^ success of the program, it was important that there be many, apprentice- 
ship positions from which to choose. This permitted ,.|ssi'tnment of position^ 
post appropriate , to individual objectives . . '' ^ 



1 
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To locate ppsitions each program dirictor at AIR was briefed on the purpos-/ and 
procedure of the cross-training program and th,e particular skills and back-;' . 
grounds of the six trainees. Whensa program director did , have a possilMe task,. 
the instructional manager* collected the following information;". “ _ 






- amount' of time required for the task, 

- beginning date, . ^ 

- due date, . - ' 

- required knowledge and skills, 

- descripti^Qn of the task trainee is expected to perform, ~ 

- supervisor's assessment of how the tSsk migfit benefit the, trainee, 

- ■ , 7 - . . 

- names of professional staff with whom the trainees will have contact. 



-i’ 



- any written materials on the case in general — proposals, progress 

reports, etc. . ^ 

.1*. ■ ' ■ ' 
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The, instructional manager then detemined whether'the task met tvyo basic , 
eligibility requirements. First the |ask had to 'be compatible with the, 
time constraints of the program. Theutime required to perform the task 
.could not exceed the amount of time a\A^able to trainees; th^e beginning 
•and due dates' had, to he appropriate, etc?===?Sg:gond, the task had t» represent 
a rich learning experience. Emphasis was,, pi ac^tN^n identifying tbsks which 
would require the trainee to learn the basic concepts^ approaches, and re- 
search designs of the' projects involved. The instructional manager elim- 
inated tasj<s which would not benefit trainee development. ^Examples include 
excessively clerical tasks such as coding. ./) • 

ItT^^eral , apprenticeship tas^^pre selected wMch vyere part of ongoing 
projects. The task had to h^v'e^he’ potential for allowing a tsrainee to. feel ■ 
that -he was a member of a%eain vyorking on a contract. Artificial assignments 
were avoided.. Trainees were expected^ to make real contributions to projects. 






\ 
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Ass,i:)Sting Trainees in Selecting Apprenticeship Positions 

The instructional liianager suggested possfble apprenticeship positions to trainees 
in the periodic'°individual meetings. Sqggestidns were based on the trainee's' 

'set of objectives . Every trainee was provided wi'th at le^t five alternatives. 

I f-a.^trainee was fhterested in, a, particular project, he would read the written 
mafer%ils available bn, it. After reading thesei materials, if he were Stjli 
interested, a'meettng was arranged betWeeo the trainee and the appropriate 
project director.. The trainee was asked to read written materials first so 
•‘ that he would hajii?*a relatively good understanding of the project before taking 
“ up thd projec^^di rector ‘s time. The final selection o'f the apprenticeship 
was based on the meeting between the trainee and1:^|ie relevant project or 
program director^. ,. ' ^ 






Monitoring Apprenticeships 









There were several objectives in monitoring the performance of trainees in- the 
apprenticeship. Most TJnpd’rtantly , it was to assure that each trainee made 
continuqtds pVogress-^b^ard his selected objectives. Trainee awareness of the 
.monitorfng probably a^o encouraged conscientiousness. Finally monitoring 
served to remind supervisors that the trainee. was there not only to work, but 
to learn. . | ^ ‘ ° ' 

The instructional manager monitored the apprentlcesh'jp by ,col 1 ectitig information 
from the trainee and the trainee 's^supervisor in the task. Information Ifrom *’ * 
the traipee was collected via the periodic meetings and "the logs. The follow- 
ing issues were noted and discussed: ' , 

, bo you feel you are malting efficient progress toward your objectives? 

^ What knowledge and skills, have -you learned in the apprenticeship? 



A’ 



' What knowledge and skills dd you hope to learn in the near future? 

A^re there’ any part;icular problems? Unclear directions? Lack of 
supervision? etc. 

Information from the trainee's supervisor; was attained through periodic 
individual meetings' Avhich focused ori the following. questions. 

How well is the trainee performing? What are his weak points, his •. 
strong points? • ' . , / 

’ What do you^Delieve the traineerfias .learned in terms of skill, know-^ 
ledge, and affect? ( ■ ’ ' ' " 

V . . , > 5C * An 

In what sireas do you believe he needs fprther study?' . 

, Are there any particular problems? . 

u 

The information attained from these discussions with both trainee and super- 
visor was used to make any adjustment necessary to improve tliie effectiveness 
, of tKe apprenticeship. It shquld be'noted that most apprenticeships worked 
out well; frequent adjustments were not required. In* a few cases, tasks were 
terminated earlier than originally anticipated, and trainees' switched to other 
apprenticeship positions. This was .not awkward since the program was struc- 
tured so that all trainees would work on several different kinds of apprentice- 
ship tasks. 

’v . . ■ c. • « 

External Apprenticeship Positions • . 

In order to maximize the number and variety of potential apprenticeship oppor- 
tunities, positions outside of AIR were also sought. The instri^tional manager 
met with the president and business director of Foothill CommuniV College tp 
identify potential positi'ons there. Meetings were also held with administrators 
at DeAnza Community College, •Rayenswood School District, and Sequoia School 
District Research Department. In each case’ several potential apprenticeship • 

' positions in educational research were identified.' 

' ' ■ ■ . • t • . 

One of the trainees became heavily involved in an apprenticeship position at 
DeAnza. ’Three other trainees wo>?ked on short term but valuable apprenticeships 
at' Foothill and Ravenswood. In each case the ^-’outside apprenticeship. was one 
of several apprenticeship tasks on which the trainee worked. The other tasks 
took place at AIR. . • > \ ' * 

The steps followed in identifying, assigning, and monitoring external appreiltice- 
.ship were quite similar to those for internal positions. In order to formalize 
the agreement, a representative from the institution sponsoring ethe apprentice- 
ship was asked to write a letter detailing the arrangement. Letters Were to ■ 
include name of trainee, name of supervisor, name of institution, period of 
appr.enticeship, description 'of apprenticeship ta^k, and descritibn of the pro- 
fessional supervision and institutional resources available for the trainee. 
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Copies of the letters received from the president/of De'Anza College 
Director of Busir^ess Services for the Foothill’ Community College Di 
showh/in Appendix F. . ' ■ ' / • 
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Description of Apprenticeships ' , , 

'fc * r * 

As previously mentioned, each trainee participated in sev6ra^. different k^Ji^s s 
of apprenticeships dur'jfg the program’. These -tasks have also differed widely-: - 
among , individual s . Examples of actual tasks performed include the following:^ 

Development of a proposal on environmental education {for 
DeAnza College) . . 

- Review and analysis' of the development of, cfhe educational product. 

Part of an AIR project to examine the process of development of 

successful educational products. . , 

1, • . * 

r 

- Assistance in the writing and production of a paper on etijployer- 
based career education. 



A more 
vi 



Assistance in the deve^ment and definition of evaluation criteria. 
Part of an AIR project to develop a system for evaluating regional 
educational laboratories and R&D centers r • 

Research and' review of the literature on the evialuation. of 'educa- 
tional administrators. 

Assistance to the Ravenswood School System in using its computer 
to work on educational problems. . ‘ ' 

Critical review and revision of the Fdpthil'l Community College Five 
Year Plan. Emphasis on student enrollment predictions. 

■■ ■ , ■ * I ■ 

Assistance on the AIR project, Coope»/ative Longitudinal Stu(iy of 
demonstration Education Programs. Wbrked on the design of. three 
questionnaires for parents and teachers of children in the’study. 

Research and presentation of information on sources of fundi ng'^,,’ 
nature of studies, and proposal dj|^ dates. ^ £ 

■ - I ■ ^ , 

coriiprahensiv^ list is included i(i'Appendix H which describes a'll the 
dual activities of each trainee. 



\ 



It may be useful to describe in more detail two examples 'of apprenticeship i. 
tasks. One trainee served his apprenticeship at DeAnza Community .College under 
the sujDervi Sion of Florin Caldwell , Director of Institutional Research.^ This 
trainee wrote one proposal for-^ the college which involved establishing workshops 
in environmental education for secondary school teachers. The trainee made 
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contact and enlisted the cooperation qf .the Sunnyvale school district. The' 
propqsal was*submitted to the Luke B. Hancqjck. Foundatiorv. The college v/as 
pleased|^ith the pro(»osa"l and the trainee qyite clearly learned a great deal 
£0m the e>y3erience of Writing it. Recent informatiop indicates that the - 
Jposal was unfortunately not funded. It will be submitted tci other .founda- ' 
tions and agenc»ie^, however. • . . i ^ 

Another trainee .became. very involved in AIR's project in Employer-Based Career 
Educ'ation (EBCE). Employer-based career 'education is a propos;ed alternative 
to traditional, secondary schools. AIR's project involved writing position 
^ papers on the system's feasibility in two areas -- individual izatioji and pupil 
• personnel services. The trainee involved in this project performecMMo tasks: 

*' (1) He' coqrdinated;final productioii of the papers including printing and dis- 
^ tribution. (2) Und^ supervision of the project director, he 'drafted 8ne 
^section. of the paper on pupil.<,personhel services. ’ 



y 



y 



Conclusions 

The apprenticeship was a very successful component of the cross-training program 
with a numbPr of advantages for both the trainee and the host institut^o. In 
terms of advantages for the trainee, the following points may be made. 

- The experience highlights the relevancy of the seminars and the 
guided independent studies. It help^ the trainee identify and 
refine his set of learning objectives. 

- The experience Produces very efficient learning. Task demands 

frequently reii^orce relevant skills and knowledge. 

• ■ - . 

- The apprenticeship provides the 'trainee with a real world frame- 

work by which to guide his Own career pursuits. .He has first 
hand experience with what educational R&D jobs ard like and what 
employees do from day to day.' ' ' 



The apprenticeship gives the trainee^ relevant R&D work accom- 
^^y^ment which may be listed in his resume. This hopefully 
incri^ses his credibili°ty to educational R&D employers. 

The apprenticeship may provide the trainee with impOrtaht professional 
contacts. Among other advantages, these contacts may lead to employ- 
ment either at the host institution or elsewhere. 
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Two advantages to the host institution jjiay be listed. 

- The apprenticeship may lead to employment at tlie host institution 
When this occurs, the institution will have benefited from a free 
trial period in which to evaluate the trainee. 
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- The host institution may benefit from the- ideas and skills tPfe ' 
trainee bring.s from the pliysi'cal sciences'; , . . ‘ 

ThB.!fact that the trainee provides* f fee labdr oa>contracts is not a clear v 
advantage.' It, is probably balanced by the necessity to provide very thorough 
supervision; . , I ' 

In'- terms of the apprenticesliiD component, the mos!> impoftan/ requirement for 
an instiitution planning to hosn-a cross-training progj?^ is thqt it have a' 
number^f diff'erent projects wijth a variety of poten^al apprenticeship' tasks 
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CHAPTER 3 



RECRUITMENT AND GENERAL ' • 
PROGRAM MANAGEMENT CONSIDERATIONS 



This, chapter 'IS divided into four sections--publ icity , application p/o- 
cedures , selection procedures; and program management considerations. 



classified advertisement, a press release, a fact booklet, and notifica- 
tion of the state and professional agencies. 



to be both effective and clear, the advertisement contained the following 
information: , , ■ , 



- purpose of the program, 

- type of organization administering the program, 

- length of program, ‘ " 

- location of program, 

- fact that it is a small pilot program, 

- brief statement about the instructional content, 

- brief statement about the instructional methods, , 

-- ^statement on job placement assistance - male and female 

- eligibility requirements, 

- stipend and transportation costs 

- telephone number 



\ 



Publicity 



Publicity designed to produce applicants for the program consisted of. a 




, ^ 



Classified Advertisement 



A copy of the class-ified advertisement is shown in Appendix G. In order 



dates and, time to call . 
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In addi tion to this information, a larger print, attention producing,- open- 
ing sentence was designed. Although this appears to be a great deal of 
information to include in a classified advertisement, it was all included 
in one ad no larger than one column by 2 1/4 inches. \ 

The advertisement appeared in newspapers according to the following schedule: 

«i*.-3»*** 

State of Washington 

Thursday, August 12 - The Seattle Times 
Sunday, August 15 - The Seattle Times 

State of California / ■ 

I 

Sunday, August. 15 - The San Jose Mercury-News 

Because of a small error in printing, the newspaper reprinted , 
the ad free ,in its morning and evening editions on Wednesday, 

August 18. . 

Thursday, Augu^st 19 - joint classified ad section of the Jf 
San Francisco Chronicle and the San Francisco Examiner. * 

There are two basic criteria foe judging the success of the advertisement. 

Does it attract appropriate applicants? Do the applicants understand the 
general nature of the program? On both counts the ad appears to have been 
successful. It produced a total of 250 calls in Seattle and Palo Alto. These . 
callers did seem to understand the nature of the program. Understanding was 
indicated by the questions callers asked. A record was kept of all such 
questions. 

The ad was printed in the column entitled. Help Wanted, Men and Women. One 
unexpected problem was a reluctance on the part of newspaper representatives 
to print the ad in the help wanted section. They argued that the ad belonged 
in the employment aids section because it was training rather than a job. We 
felt the ad would receive better exposure in the help wanted section. We argued 
that the trainees would receive a stipend, and that the terms of- the program 
were clearly explained in the ad. In the end', all newspapers did prini th§ ad 
in the help wanted section.^ A surprising number of man-hours were required to 
resolve the issue, however.' 



Press Release » 1 

A copy of the press release i's shown in Appendix H. The article gives a general 
overview df the program. Information is presented on what educational researchers 
actually do since this is generally an unknown field to the public. A press . 
release concerning unemployed aerospace workers is of high regional interest and 
is likely to bd noticed by newspaper editors.- 



The release was submitted to the following major newspapers on August 11, 1971. 



News articles have appeared in the Seattle Times .and the Palo Alto Tim4s. Copies’ 
of the articles appear in Appendix H. The release wa^ timed to coincide with the 
advertisement, thereby increasing the number of aerospace workers who would know 
of the program white the opportunity to apply still existed. Because of this the 
press release.was written to describe the program before it began. • \ 

One effect of the newspaper articles was' to alert local educational institutions 
to the program. We received three calls from administrators who were interested 
in having trainees work with them as apprentices on particular educational researc 
and development projects. These opportunities were considered in terms of the 
individual objectives of the trainees. Several working relationships did develop 
and will be described in the section on the apprenticeship. 

One minor but potentially troublesome problem is newspaper editing of the press 
release. , For example, it its article the Seattle'Times claimed that 20 unemployed 
aerospace workers would be selected for the- program. Such. a statement did not 
appear anywhere in the press release. \ 



Fact Booklet 

In order to provide comprehensive information on the program to prospective 
applicants, a small fact booklet was developed. Structured in question and 
answer format, it covers the following information from the point of view of 
the applicant. 



What is the purpose of the program? 

Who'are the sponsors of^the program? 

Where will I be trainedf* . 

When does this program start and^how long does it last? 
What will the training involve? 



State of Washington 



Seattle Post-Intelligencer 
Seattle Times 
Tacoma News -Tribune 



StAte of California 



San Francisco Chronicle 
San Francisco Examiner 
Oakland Tribune 
Palo Alto Times 
San Jose Mercury-News 



Press releases were also submitted to 15 radio stations and 4 television stations. 
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kind of background’must I have to be eligible? 

, ^ How will trainee selection be made? 

W 11 I be paid during training? 

' ' V-Dd I pay ihcome tax on my stipend? 

What kind of activities are involved in educationa.l 
research and development? 

Will I be guaranteed a job? 

What kind of joD responsibilities and salary can I expect 
if I am successful in future job placement? 

Where are educational R&D jobs located? 

What arrangements wi 11 be made for living accommodations 
during training? 

Will I need a car? 

What provisions will be made for my household and family? 

Content of the entire booklet is shown in Appendix I. ■ 

The fact booklets distributed in the states of Washington and California differed 
in only one respect -- information on unemployment benefits. The Washington 
booklet informed applicants that they would be eligible for unemployment benefits 
during training. The California booklet Wid not. Trainee eligibility for 
unemployment benefits will be discussed in a later section of this report. 

' 'i ■' 

The fact booklet has been judged'effecti ve because almost all applicants under- 
stood the basic format of the program. Several recurring questions by applicants 
did indicate four points on which the booklet could be improve^.^JJ If aerospace 
affiliation is a requirement in the field test, then this requirem^t must be- - 
more specifically defined. 2) It is suggested that unemployment pqr se whether, 
it has, been for one day or one year should render the applicant eligible. It 
is also suggested that applicants who are underemployed should be eligible. 

3) The fact booklet should- emphasize R&D . It should explicitly state that the 
program will not prepare trainees for teaching. 4) The U.S.A. permanent 
residency requirement should be explained. ' 

. t, 

) ■ '■ ■ 

, , ^ , 

Notification of State and Professional Organizations ' . • 

The state Unemployment agejicies were contacted and the program explained: These 

agencies then posted information ^ the program. Tn Cali fornia each of four, 
local offices -had to be contacted^parately in order to insure that information 
would be posted. 

• ' I 

In addition to the regular state agencies, both the Seattle and San Francisco 
areas have self-help associations composed of unemployed engineers and aerospace 
professionals. The program was explained to representatives of Talent Plus in 
Seattle and Experience Unlimited in the San Francisco Bay Area.' Members of both 
these associations did submit applications. 
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Female Applicants ' 

Affirmative action was taken to encourage women to apply to the program. State 
unemploynient offi ces we re.-in formed of the need for more female, applicants . 
Representatives of self-help associations of unemnlpyed aerospace workers were 
contacted and asked to refer women in particular for the program. The advertisement 
end press release were specifically worded to emphasize both male and female 
trainees. The number of women in the manpower pool is discussed in the companion 
report to, this, project, th^ feasibility analysis (Melnotte, 1971). 
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Application Procedures 



Upon hearing abput.the program an interested persp^ called the designated, 
phone number. We answered any initial questions the-caller had “and then offered 
to send the fact booklet and an application. This was 'a very efficient procedure 
tach.jnterested person received complete “information on the program. Alternative 
procedures such as orally describing the program to each caller, or conducting 
explanatory sessions for prospective applicants would have been more expensive 
“and woulfd not have insured each applicant complete information. 

I \ 

The publicized nunber of telephone reception days was three and. the majority of 
calls did come during this period. Late calls were infrequent; they were 
accepted for two days. Initially, calls averaged roughly one every five minutes 
in Seattle' and- one every ten minutes in Palo Alto. This frequency diminished 
by the third day. \ y 

Trainees submitted an application which included the following information; 



post high school educational history- 
^ employment history 
specij'al skills 

professional nj^mberships and offices held 

publications 

honors/awards 

minimum salar^ acceptable after training 




The” recrui tment and selection period was not long enough to secure official 
transcripts of. college records. Applicants were requested to submit a I'ist 
of their post high courses and grades orjan unofficial xerox copy of a 
transcript. This procedure did expose us to the possibility of receiving, 
falsified records, but thiis risk was, deemed minimal. The alternative was 
to have no record of college work. the selection process it was useful 
to review the kind of courses the applicant had taken in college. 

The applicant was also encouraged to answer several questions on his interests 
and associations in the field of education. 



1. In what areas of education are you most interested and why? 

2. Has a close associate or anyone in your family been active 
y in..the field of education? In what capacity? 

3. Do you have skills which you believe are particularly applicab„le ' 

to the field or education? Please specify. ' 

4. Have you had any community or employment experiences, which you 

feel. are -relevant to activities in the fielcfof education. 

5. Further comments, if any. 



Criteria for selection will be discussed in the next section. It is appropriate 
here, however, to make several recommendations for the application which could 
be used in a field test of the model. All^f the information mentioned above 
was useful in. the selection process except question 2. This question was 
intended to explore the applicant's familiarity with the field of education. 

In reality, the question provided very little information. Almost every 
applicant listed a brother-in-law, etc. who was a teacher. Questions 1, 3, and 
/ 4 were particularly valuable in the selection process. It might be wise to 

instruct the applicant to pay special attention to these questions since they 
will ,be of primary importance in the selection process. In another area, the 
application should determine the applicant's status vis a vis U.S. citizenship. 
According to the law, only U.S. citizens and permanent residents are eligible 
for the stipend. This is an important consideration for the application; a 
surprising number of applicants held foreign citizenships. 
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Selection Procedures 
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Eligibility ^ , 

For the pilot test of this model three basic requirements were defined. The 
applicant had to hold a B.A. or B.S., be unemployed, and'^ associated with 
aerospace. The requirement of a B.A. or B.S. was selected not because it was 
a necessary qualification for successful participation in the cross training 
program, but rather because securing a job in educational R&D without it might 
.prove quite difficult. Although the rule was stri ctly. enforced, several persons 
without the degree did apply. In some cases they had strong backgrounds and 
had advanced quite far in the aerospace industry. In the future, consideration 
might be given to waiving this rule in exceptional cases. 



A detailed analysis of the pol^ation which applied to the program is preset 
in the companion feasibility analysis (Melnotte, 1971); a brief description 
be presented here. Out of 250 people who called, 175 submitted written app' 
tions -- 9 women and 166 men. Of this number, 27.6% had degrees beyond the 
B.A. or B.S. primarily M.A. 's .-The average age of the applicants was 43. ^ 

The average last salary in the aerospace industry was $14,450. 29.3% had been 

unemployed for less than 5 months, 27.6% had been unemployed between 5 and 9 
months, and 43.1% had been unemployed 10 months or more. 



Selection Criteria 

Criteria used for selection include the 



- evidence of interest in educatio larticipation, specific 

education ide.as), J 



education (previous pl^ns or steps taken to change careers, present 
career objectives), ' 

- existence of skill's useful in education (data processing, data . 
presentation, report and technical writing, proposal development, 
evaluation skills, etc.), 

- reasonable salary, expectations' ($8,000 - $12,000, morefonly in 
exceptional cases),, 



Description of Applicants 





- existence of specific personal career objectives within the field of 
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- evidence of success in college (grades, awards, publications),- 

- relevant course work in college (psychology, education, statistics, 
sociology), 

- evidence of success in employment (prpmotions, publications, specific 

accomplishments). . 

The selection procedures were structured into 4 stages. Parallel steps were 
followed in the Seattle and San Francisco areas. (1) Approximately the top 
24 written applications were selected for each state. (2) These 24 applicants 
were given written tests and the top 12 were- selected for interviews. 

(3) Interviews were used to select the top 6 from each area. (4) A panel of 
program directors at AIR selected the final 3 for each area. 

IT , • ■ 

1 

Selection of Top Wi^itteh Appli cations. . * 

{ '% 

Each written application was evaluaxedi'by two judges. A grade was assigned 
using a scale of I to 5. For the mosIf'Vart the judges agreed. A third judge 
was employed, however, in those casesViwhen the first two ratings were in dis- 
agreement. Applications from both the Seattle and San Francisco ar,eas were 
evaluated in the AIR Palo Alto office. 



C 



Written Tests , . 

The 24 finalists 'in each area were phoned and invited to take two tests as 
part of the selection procedure. In order p) avoid raising false hopes, 
finalists were advised that there were still many more applicants than 
positions open. The tests for the Seattle applicants were administered at 
the School of Education, University of Washington. California apVlicants 
took their tests at AIR, Palo Alto. 

Test 1 was a 1/2 hour writing sample. Applicants were informed that emphasis 
would be placed on their abf[ity to write clearly and concisely. The ques- 
tion was selected to requifV~no technical knowledge, but to be indicativef 
of the candidates' interest in the field of education. The question was as 
follows: "Briefly present arguments for and against universal college edu- 

cation in the United States." Each paper was graded separately for 
(1) clarity of'writing, and (2) general content. Both were equally weighted 
in final selection. . - 

Test 2 was thd* Undergraduate Record Examination in Education--a standardized 
multiple-choice test cqnstructed by ETS. The/test did require specific 
knowledge and therefore was primarily used only to eliminate those candidates 
scoring unusually low. i 



V ' ’ 

On the bcisis of these two tests, twelve applicants from each area were se 

lected for interviews. 



Interviews ^ ' 

One-half hour interviews were structured to investigate the following ques- 
tions. (1) How interested is the candidate in the field of education? <Has 
he seriously thought about a career change/into the field? (2) Does the 
candidate have .skills which would be usefdl in educational R&D? (3) How 
flexible is the candidate? Is he willing to take a job only in one city, or 
is he willing to movijs? (4) Are his salary expectations /reasonable? (5) Is 
he prepared to take an' entry level positi^ion in a new fjeld after o^upying. a 
high level position \,n his?fornfer fi^ld? (6) Does he seem to have basic 
social ski.lls which^are -requiret^for success in the team approach used in 
most education research? y . , , , . 



Seattle finalists werd interviewed the day after testing at the University 
of Washington. California finalist^ were interviewed' during the .two days 
succeeding Resting at AIR, Palo Alto, Six candidate^f’"''"! each area Were 
selected foF final screening.; 



FinaH Selection , ' , 

Final choice was made by a panel of program directors at the American 
Institutes for Research, For^^each.area the panel rankedHhe six candidates. 
The top three were invited to join the program,' The second three..were 
designated as alternates. Those selected for the program were immediately' 
notified by telephone so they would have maximum time* to prepare. This was 
Pfirticularly important for Seattle residents. Contract period constraints 
were such that even with the special steps taken to insure rapid selection 
procedures, the Seattle trainees had only two weeks in which to arrange . 
relocation. ' . 



Characteristics of the Sel ected^^^?fSi nees 

Characte.ri sties of the trainees actually selected for the p»:ogram are sum- 
marized in Table 1. 
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The table does not reflect certain special background points of the selected 
trainees. For example, one trainee was a member of his city's Citizen 
School Advisory Co.uncil. He enclosed a copy of his report with his'applica- 
tion. In his interview, this trainee demonstrated a very extensive know- 
ledge in the psycljoTxrgy of learning. This background, was gained totally from 
leisure time rea<ling. Another trainee had made the decision to .transfer into 
the field Of— psychology or education several years ago. He had begun taking 
graduate courses in psycho, logy'. He saw the cross-training program as an 
ideal opportunity to break into this new field. A third trainee had also 
been attempting to break into the field of education. Several months prior 
to the program he had received a grant from a local foundation and had 
written a teacher'.s manual in environmental education. 






Rejection Letters . ’ 

' Each applicant not ?iccepted for the program was sent a personal letter of 
regret. The MT/ST typewriter was used for this purpose. A copy of the let- 
ter is shown in.Appendix 'J. A stronger letter was sent to applicants who 
made it as far as the testing stage. This is shown in Appendix K. 
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- ^ Program Management Considerations 

f 



Stipends . - . . 

Trainees were paid a living expense stipend of $75 per week plus $15 per week 
per dependent. This allowance was not subject to taxation’. Trainees were 
asked to sign a simple statement to verify the number of their dependents. 
This is shown in Appendix L. Dependent was defined according to the Internal 
Revenue Service standards. ^ Trainees were paid at the end of each two-week 
period. This was frequent enough to avojd placing a hardship on trainees 
and not so often as to create excess paperwork for the managers of the"pro- 
gram. Regular AIR- staff members are also paid every two weeks. On one oc- t 
casion, a trainee with .particular financial difficulties was given ^ad- 
vance on this stipend. Two of the trainees left the progVam several weeks 
early in order to accept jobs. On these occasions the stipends were prorated 
to the" day trainees left. ' 
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Travel Allowance 
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Trainees from the Seattle area were given the equivalent of the round trip 
air fare from Seattle to San Francisco. Thi s'' allowance was paid regardless 
of the actual travel mode selected by trainees. Two trainees drove their 
own cars down so they would have transportation while in the Bay area. The 
travel allowance was paid in two installments, one when trainees arrived and 
the other just before they left.' One trainee asked, for the travel allowance 
before leaving Seattle. 'This was arranged. ' , ' • 

In o»*der to avoid the possibility, that a traine? would accept a travel allow- 
ance and then' leave the program, trainees were asked to sign a statement before 
receiving the allowance. The statement obligated a ^ainee to return a pro-> 
fated portion of the travel allowance if he left theCpVsogram for reasons other 
than'‘ health, extreme family hardship, or the acceptance] of a job in educational 
research gmd development. The statement is shown in Appendix M. ' ' ■ 



J . 

Reloc-ation Assistance for OutrOf-State Trainees ■ 

Out-of-state trainees were, given assistance in matters of relocation. Motel' 
re^rvations were arranged so that trainees would h^ve a temporary residence 
whi/e they searched for apartments. Trainees were given apartment hunting 
information on availability, average rents, neijghborhoods , etCj^ 



General Integration with AIR Staff and Procedures ' .... 

j 0- • ^ 

Procedural and logistical arrangements wer? made in order to insure complete 
integration of the trainee^ with th^ regular AIR staff. Trainees were assigned . 
desks'and space throughout tfene bqilding in offices with AIR professional. 

„ staff. This was designed to increase exposure to processes and people in 
educationa‘1 R&D'. Trainees were also provided telephone service, mail distri- 
bution, and access to all office equipment. They had complete use of .the AIR 
library and its special arraqgehient with the Stanford University libraries. 

They received regularly 'routed research newsletters and other materials. 

. There were some initial management fears that the presem^ of six naive 
trainees working *thropghout AIR might require an inordin^e amount of -super- 
visory and explanatory time or. generally be disruptive of an ongoing efficient 
work pattern. These fears did not materialize. 'Trainees seemed to benefit 
- greatly from the integration without significantly interfering with work patterns, 
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Another important step to protect morale was, the conservative stand admin- 
istrators took, with reference to the possibility of obtaining jobs. Special 
— care was takefi to avoid giving the trainees false hopes. ( In the past some 
training programs have suffered a serious morale crisis When the unrealistic 
hopes of the participants were finally dashe.d by the realities of the job 
market situation. » ' . 






f . I 

Trainee Moral ‘ 

Trainee morale can have an elusive yet substanti-al effect on the success of 
a program. Several steps were taken to keep morale high. "Informal group 
luncheons were helcf frequently. Trainees' were, of course, invited to alT 
company parties. Several dinner parties were held for all the trainees. 

Future programSj^ might consider incorporating a small discretionary fund which 
could be used for several morale building activities. These mjght be as 
simple as providing coffee and donuts during the initial orientatiop meeting. 



Unemployment Benefits 



Residents from the State of Washington were clearly- eligible for unenjploym'ent 
compensation and did indeed receive it. In order to insure eligibility, howevcr„» 
this project director had to write the special services section pf .the Washington 
_ Unemployment Office, t It was necessary to. describe the training prog'ram in 
detail so that a ruling could be made. ' " 



r 




^California law on the eligibility of the trainees for unemployment compensatiori 
is ambiguous. This was determined through lengthy conversations with adminis- 
.trators at the Palo Alto Unemployment Office, the San Ma.teo Unemployment Office, 
and the regional headquarters in San Francisco. A legal interpretaition from • • 
Sacramento, may be necess.ary. No state ruling of interpretation has yet been 
'made for any program resembling ours. The state law requires that persons 
receivinjg unemployment benefits must be. "looking" for work" and must Be "able 
and available"”fof work. Trainees in the program did meet the criterion of • 
"looking for work" Jbecause the curriculum itself incorporated job hunting 
. information and activities. Traitiees were free and indeed encouraged to attend 
' job interviews in the field of educational research and. development ,at any . ' 
time during the program. In order* to meet the "able and available" clause, 
trainees were .officially informed that they could le?ive the p'rogram at -any, 

• time -to take a job.. .These requirements were thus satisfied.' It’is the stipend 
which may void a trainee's eligibility for unemployment insurance.- • ' * . 
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Since California law is ambiguous, our choice at this point was either to take 
the case to Sacramento — a relatively lengthy and expensive process — or 
simply wait to see how the local unemployment office would handle the case. 

Only one California residept was eligible for benefits; the others had 
exhausted theirs. With this fact in mind, the second alternative was selectejd. 
As it turned out, the local office interpretation was that the trainee was 
eligible, and he was paid. Since the law is ambiguous, however, we cannot 
predict that trainees in any future program will receive benefits. It is likely 
that a larger-scale program would result in the local offices themselves asking, 
for a ruling from Sacramento. There is no way to predict what this ruling 
would be. 
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CHAPTER 4 

JOB PLACEMENT ACTIVITIES 



In the latter half of the program' increasing ^phasis was placed on locating 
openings and applying for jobs. This chapter will review those activitiejs. 

One of the first tasks was the rewriting of resumes to reflect skills and\ 
experience relevant to educational R&D. Trainees all had such skills yet \ 
this v/as not easily determined. In general, engineers do not know enough \ ■ 
about educational R&D to identify relevant skills themselves. Similarly, 1 
educational researchers dp not know enough about the various fields of en- | 
gineering to make the identification. This program helped bridge thewap. 

In their resume^trainees emphasized, their skills in report writing, pro- 
posal writing, '^^Hfedul ing, data analyses and present^efe4pn, evaluatiqn^ro- 
cedufes, administrative systems, and technical writing, ^requeritiyfa 
trainee's experience seemed irrelevant when explained in ^gineering terms, 

-but very relevant when described in the language of educational R&D. The 
rel'attonship between engineering and educational R&D is being further studied 
by the National Society for Professional Engineers which has been given a 
Department of Labor contract to survey employment areas to which engineers 
may transfer. AIR has been involved in the educational R&D component of the 
study. ^ ' 

Several seminars were held in which job hunting strategies were planned. The 
seminars included both' structured discussion of pre-planned ideas ^and tfrain- 
storming by trainees and staff. 

Four of the six trainees are currently employed. Two are still looking for 
jobs. These results will be discussed in a later ScctioR of this/^hapter. 
First, the job hunting strategies will be rfe'scribed. 

•t„.J 



Job Search Strategies 



Five basic strategies were followed in searching- for jobs, 

1) An attempt was made to take full advantage of contacts developed at AIR. 
Attention was given both to potential jobs at AIR itself, and jobs in other 
organizations in which AIR staff members might have contacts. All program 



directors at AIR were alerted to the fact that- trainees were looking for jobs. 
Informal meetings with program directors and other staff members were used to 
explore possibilities. ’ 

Ohe trainee's'^apprenticeship lead to contacts both in and outside of AIR which 
resulted iiy^ job. . Because of his work on the employer-basdd career education 
contract, M met an official from Far West Laboratory who asked him to submit ,, 
a resume and then later hired him. 

In another example, an AIR staff member who had lived and worked in the Pacific 
Northwest met with the Seattle trainees to suggest possible courses of action 
in that area. Discussion focused on individuals who might be contacted and 
organizations with potential openings, ^uch as an expanding community college 
system. - . ^ 

Potential job contacts were also established during the professional confer- 
ence on Career Education and Development ’hosted by AIR. During the conference 
the crossiitraining program was described, the trainees' skills and backgVound 
ummarized, and the availability of the trainees for employment noted. Trainees 
Iso had the opportunity to engage in casual discussions with various profes- 
sionals in the field, many of whom were potential employers. The conference did 
result in further job exploration. 



Several trainees with expertise in specific areas were included in proposals 
submitted by -AIR- This strategy added still another possibility for a job. 



Employment inquiry lel'uers were sent to many AIR contacts in other R&D organi- 
zations. Written by the project director, the letters described the cross- 
training program and the background of the trainees. An example of a letter 
is shown in Appendix N. Resumes of appropriate trainees were included with 
each letter’. • 



Appendix 0 contains a list of the organizations to which employm'^nt inquf/ies 
were made. This list includes inquiries made by AIR staff members on behalf 
of the trainees and inquiries made by trainees themselves. 



2) Trainees and staff members remained alert to all important new contracts 
awarded in the field of e;ducational R&D. Resumes were submitted to organizations 
which received such contracts. A number of procedures were followed to locate 
the new contracts. The AIR confidential newsletter lists the recipients of 
contracts on which AIR has bid. This was one source of information. The 
newsletter was circulated to all trainees. Several other newsletters, such 
as Behavior Today and Review of Educational Research , also announce newly 
awarded grants and contracts . The business section of newspapers frequently 
carries articles on companies which receive large contracts. 



This approach was followed in a number of cases. When the Office of Education 
awarded three proposal writing grants relating to the voucher system, one • 
trainee with expertise in this area submitted his resume to all three organi- 
zations. In another case, ah\article in the business section of the local 
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paper described a contract awarded to a 'private company to train pepple to use 
the computer. One trainee applied to this company. 

3) Trainees were strongly encouraged to rethink their own personal contacts in 

the light of their new profession. A trainee, for example, mi^ht have a, brother- 
in-law who works at an educational R&D organization^- Traine/s do not necessarily 
think of these contacts without some prodding. They may overlook important i 
personal contacts simply because they *a»fe not yet accustomed to thinking of j 
themselves as educational researchers. , / 1 

/ ' / ^ ! 

4) Trainees were encouraged to explore the standard methods of locating jobs j 

in educational R&D. The APA Employp/ent Bulletin was'^examined each month; the! 
Educational Researcher employment 4ds were read; c^Tvil services employment was 
was explored. It should be noted^that most of tjie jobs listed in the APA i 

Employment Bulletin were academi/I positions. Few related to research and j 

development. Civil service employment did offer some potential. Several . | 

trainees attended interviews for civil service jobs both in California and | 
other states., ■> ■ i 



5) After all' contacts, contract leads, etc. were explored, trainees sent 
their resumes , to all the remaining R&D/organizations which interested them. | 
The Far West survey of R&D employers in the San Francisco Bay area, discussed 
in the introduction to this report, ierved as a valuable aid in this strategy. 
Trainees used the raw data from the survey to select R&D organizations which' 
predicted they would need B.A. and M.A. level personnel during the coming ' 
year. As previously mentioned. Appendix 0 contains a list of all organizatibns 
to which employment inquiries were made wither by AIR staff members o'^ trainees 
themselves. 






Relevant Federal Prograi^ 



Federal Programs 



A number of federal programs were available to assist engineers, scientists, 
and technicians locate and begin work in new jobs. These programs were 
investigated and used whnever possible. 

■ . . 1 

One provision of a federal program provides a. reimbursement for employers when! 
they higher someone not fully trained for the position. To qualify for the .\ 
reimbursement, ihe employer must pay a salary of at least $8,000 per year. 
can be reimbursed up to $2,000, the total depending upoii how much training is \ 



\ 



required. The total is negotiated between the employer and the state unemploy- 
ment agency which administers the federal funds. Negotiation can take place on 
a contingency basis, that is, before a firm employment offer is made or accepted. 
The program also provides funds for the employee to travel to the location of his 
new job. • 

r 

Whenever appropriate, the above program was explained to potential employers. 

It added one more attractive element, to the hiring of the trainees. 

Probably the most useful provision of a federal program was one which provides 
funds for unemployed engineers, scientists, or technicians to travel for job 
interviews. Up to $500 per applicant is available. One trainee used these 
funds to travel to Minnesota and Wisconsin where he had interviews for civil 
service jobs with both states' departments of 'education . 



1 Results 



Out of the six trainees, one was rehired for his previous position At the 
Boeing Company, three got jobs in educational research and development, and 
two are still looking for jobs. ,, 

The three jobs in educational R&D may be described as follows.- One is a 
part time job at American Institutes for' Research. This trainee will work 
toward a Maste^rs degree in psychology at the same time. Another is a research 
analyst at DeAnza Community College. The task calls for the analysis of the 
college's various educational programs in order to determine their relevance, 
and cost-benefit to the community. The salary lies in the $12,00-$13,000 range. 
It should be noted that before taking the DeAnza job this trainee also worked 
temporarily 'at F,ar West Laboratory. A permanent job at the laboratory was 
contingent upon receiving certain funds, and- although this was probable, it 
was not certain. ' 

A third trynee is now coordinator of the-Work Experience Program at Gavilan 
College in^ilroy, California. The fro^Vam allows students to receive credit 
for specified work performed outside of the college. 

The fact that trainees were able to secure these positions in the field of 
education at a time and place in which the job market is particthlarly tight 
demonstrates one important aspect of the model — graduates of the cross-training 
program are acceptable to potential employers. The ultimate test of the model, 
of course, will be the effectiveness of the graduates in their new positions. 



CHAPTER 5 



CONCLUDING COMMENTS 



This project has-dealt with the development an apprenticeship work-study 
model. A separate companion project evaluates the operational feasibility of 
the model. In-depth conclusions regarding potential effectiveness and fecisi- 
bility are contained in j:hat project report. Please see Melnotte, J. M., 

Mi 11 stein, E. M., and Dunn, J. A., A Study of the Operational Feasibility of 
the Apprenticeship Work-Study Program for Multi -site- Tryout and Evaluation 



iGrant No. OEG-0-71 -471 1 ) . The evalu^ion focuses on tne feasibility of a 
larger scale program, the confirmation or improvement of specific components 
of the model, and the identification of effective evaluation procedures and 
instruments which could be applied to< a future large-scale field test. The 
basic questions investigated include: 1) How effectifve is the program in terms 

of knowledge and skills gained? 2) How general izable or exportable is the 
model? 3) What is the trainee reaction to the program experience? 4) What 
should be the content and 'procedures for. fol low-up?. 5) What are the con- 
straints on and advantages for the institution conducting the training program? 
6) What applications of the training model are feasible? 

Jhe need for quality personnel in the field of educational research ancT^ 
development during the coming years will be critical.. The training model 

‘(V developed in this project offers one method for helping fo meet this need. 

It may be employed to improve the skills of those already working in the 
field, or to train new people for the field. 

. 

Individualization is a significant aspect of the training model. It permits 
special attention to be given to the particular <skil Is each, trainee, wants 
to develop. It makes possible rapid, sjjjort-term instruction. Trainees do 
not spend long hours in classrooms studying materials which are of ques- 

/, tionable use to their own career objectives. They study materials which 
have been selected as particularly relevant to their needs. They work at 
their own pace with professional supervision. 

The apprenticeship is another significant component of the model. It offers 
the potential of very efficient learning. Irrelevant knowledge is not 
dwelled upon while relevant skills and knowledge are reinforced frequently. 

It provides the trainee with a real world framework by which to guide his 
own career pursuits. It may help him to identify and refine his own learn- 
ing objectives. Finally, it may increase the trainee's credibility with 
potential employers and provide him with important professional contacts. 

Th'fr-model is likely to appeal to employers. In ‘addition to being effective 
and to satisfying the students, a requirement of success is that the model ^ 
satisfy the employer. This is not a simple task. Training-models can inter- 
fere with t^he operation or cost structure of an R&D organization. An intern- 
ship model, for example, in which an employer is ’required to pay an intern 
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and also give him structured training is not likely to be well accepted by 
employers. Such a model puts a double burden on the employer. He must pay 
for valuaible supervisor time in training the intern and he must pay the 
intern. /The apprenticeship model on the other hand is likely to be of 
maximum appeal to employers and is, therefore, ilTore likely to be accepted. 

The employer does provide valuable supervision for the trainee, but in re- 
turn he receives the trainee's free labor. He is also provided with an 
inexpensive method for trying out prospective new employees. In general 
the pilot test of this model has suggested that the integration of the 
trainees with the regular staff presents no. problem for employers. 

The model is exportable. This is hypothesized because the training does not 
rest on factors unique to AlR. The model can easily be recreated at other 
educational research and development organizations. The prime requirements 
are that the host organization have (1) a moderately large number of educa- 
tional R&D professionals, perhaps five per trainee, (2) a large number of 
R&D projects, and (3) a library or easy access to a library. Procedures for 
duplicating this training program are carefully detailed in a manual which 
accompanies this report. Please see Millstein, E. J., Melnotte, J. M. , and 
Dunn, ^ A., Procedures for Conducting an Apprenticeship Work-Study Program . 
Much of the information contained in the manual is also contained in this 
final report; however, the manual focuses on how to conduct a future program, 
while this report has concentrated on what happened in the pilot program. 

The manual is divided into four major sections: (1) an over-view of the 

model’, (2) procedures on how to conduct the instructional system including 
descriptions of the curriculum, individualization, and the apprenticeship, 

(3) procedures for trainee recruitment, selection, and general program 
management, and (4) procedures for assisting the trainees in finding jobs. 

The model-is very useful. It provides B.A. and M.A. level personnel trained 
^in applied educational research and development. This is in contrast to the 
majority of training programs which generally provide Ph.D. level personnel 
trained only in pure research. 

n 

The training model has numerous applications. It can serve as an independent 
training program much in the way it was employed in this pilot project. In 
such an application, no connection with a college or university exists. The 
target population depends on current needs in the field. The program may be 
used to bring new personnel into the field through cross-training, or to 
rai’Se the skills of those already working in the field. 

The training model may also serve as an adjunct to a regular academic pro- 
gram. In this context the..student spends part of his time in academic work 
at a college or university and part of hi s’ time as an apprentice working on 
actual projects at an educational R&D' organizc^tion. The model is appropriate 
for both profesjjonal and paraprofessional levels. 

. < 

The-ffirfcl^ may also be useful for in-service training. In this application 
the training takes place entirely at an R&D organization and is designed for 
selected employees. It can be used botf? for the upgrading and improvement 



( 



»■ I 

of current employees and for the training of new employees. This is poten- 
tially of great use to both profit and non-profit R&D organizations, and to 



The present project has been viewed as step' 1 in a developmental effort. 

The model has been developed and its operational -feasibility tested. The 
next step should be a multi -site field test of the utility and effectiveness 
of the model'. • 
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Objectives 

Library Skills 

Can describe the organization of a card 
'Catalogue and locate entries regarding: 

a. author^tltle 

b. subject j 

^c« documents 

d, pamphlets 

e« tests 1 

State^^tHSN^neral structure and types 
of Information given In sources par- 
ticularly associated with education: 

a. Education Index 

b. Psychological Abstracts 

*c« Encyclopedia of Educational 
Research 

d« Dissertation Abstracts 
e« Relevant ed, sections of 

Guide to Periodical Literature 

Describe the types of Information 
available and be able to locc^te and 
obtain dlcuments and Information from 
the DATRIX and ALERT systems « 

State the function and organization 
of the ERIC system. 

Describe the types of Information 
stored In the ERIC syatem, the vari- 
ous reference tools us^d, and the. 
forms In which ERIC docuu,ants are 
supplied. 

Explain the procedure for ordering 
hard copy and microfiche copies 
from ERIC, 

State the. content and structure and 
locate and Interpret entries In the 
ERIC reference tools of Research In 
Education and Current Index to 
Journals In Education * 

/ 

State the function and organization » 
Interpret, and use the Thesaurus of 
ERIC Descriptors t “ 
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Objectives 

Library Skills (cont.) ^ 

I ^ 

Describe^ the function of and state 
the gei^ral procedure for retrieving 
information through the ERIC DIALOG 
systeoM. 

Can locate and use special equipment 
and devices typically found in libra- 
ries , such as microfilm readers. 

u 

Prepare a statement of purpose of a- 
survey of the literature related to a 
given topic or problem in educa^^. 

States descriptors or key* words to 
guide the search. 






; 



.‘’re^ares a detailed search strategy 

/ \ 

Retrieves bibliographic entries and 

documents and prepares bibliographic 
cards according to a standard' fprmat 

Can scan and screen retrieved\ docu- 
ments for relevance. 



Prepares abstracts or annotated bibli- 
ography of relevanT^^cuments cpvering 
brief statements.^of problem > sample > 
method., findings ^ discussion. 

Classifies ^ indexes , and organizes 
bibliography cards and abstracts with 
such as McBee sort cards. 

Ins trumentation 

Describe! stat^ the functions of> and « 
discuss the advantages arid disadvan- 

. tages (where applicable) of equipment 
with application in education, (eg. 
programmed learniil^ machines , student 
response systems equipment, in area of 
teachirig/learning ; equipment commonly 
used in experime^ptal situations > atuo- 
mated assesam^sHT equipment). * 



n 


§ 




u 


u 




00 


00 




0 


0 




u 


u 




cu 


p. 




OJ 


00 




u 


p 




0 • 


•H 




4^ . 


u 




OJ 


p 




uo 


na 




0 


na 


0 


na 


OJ 


na 




u 




na 


•H 


u 


rH 




w 






p 


0 


u 


p 


o 


< 


o 



If can do; 
Degree of 



Expertise 




Skills you 


1 


0) 






would like 


4J 


P 

p 


00 

rt 




to emphasize 


00 


OJ 


M 

0 

p 




in balance 


rH 

cn 


ig 


u 

w 




of program 



' \ 



^ \ 






4- 

















1 


1 ' -n J-. 













1 


1 ' 

^-j 





.1 






(>. 



i. 

3 



47 - 



‘S, ^ 










L 



\ 



\ 

t\ 



/ 



■I, 

mc^ 



r.-:: 






Objectives 

Instrumentation (cont.) 
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Be able to locate sources of 
hardware i 




Name and describe the common types of 
data gathering and assessment Instru- 
ments) eg. questionnaire, essay, In- 
terview schedule, critical Incident 
Instruments, and the various types of 
objective tests — multiple choice, 
true-false, short answer, matching, etc. 



State the purpose (or ^ommpn applica- 
bility of ) , advantages and disadvan- 
tages of various types of Instrumentation 



Discuss the guidelines for quality 
commonly associated with various 
types of Instruments (as to presenta- 
tion and layout) • 



■•i 



'summarize the basic statistical concepts 
associated witK tests such as reliabi- 
lity, validity. Item sampling, correc-* 
tlon for guessing, measurement error. 

Item analysis, etc. 

State general principles In writing- 
pbjectlve^^estl:^ Items such as appropriate-; 
ness bf cpnC^t and difficulty, brevity, 
accuracy, sli^le answer, grammatical 
correctness ,'^^osltive wowilng, absence 
of dependent cues, etc. 









Discuss a general strategy for planning 
and developing assessment and Informa- 
tional Instruments. 



Describe general content and structure 
of a variety" of commonly used Instru- 
ments, eg, Stanford-Blnejt , MMPI, etc," < 



Be able to locate, or obtain specimen 
sets^qf tests through libraries or 
compai^s « 
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Data Collection 



Xian describe the general nature of a 
variety of interviewing techniques 
(eg. structured, focused, etc.) 

Can plan and develop interview sched- 
ules which represent various interview . 
techniques • 

Given specific R&D problems, discuss 
the application, advantages, and disad- 
vantages of vatious interview techniques. ' 

Can apply appropriate interview tech- 
niqties in conducting interviews of the 
types likely to be used in R&D projects. 

Can describe the general nature of ar 
variety of observation techniques (eg. 
time sampling, anecdotal record, etc.). 

Can plan and develop observation sched- 
ules which represent various observa- 
tion techniques . 

Given specific R&D problems, discuss 
the application, advantages, and 
disadvantages of various observation 
techniques . 

C^'^apply appropriate observation tech- 
nlcues in conducting observations of 
the types likely to be used in R&D 
projects. 

Summarizes the basic principles asso- 
ciated with standardization (eg, com- 
monness of directions, timing, etc.) 

Explains why standardization is impor- 
tant and can identify those assessment 
situations with which it is most likely | 
to be .associated or not particularly 
associated. 
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. , Objectives 

Data Collection (cont.) 

V 

Identify the ranges of expertise and 
training required to administer various 
types of tests under certain conditions 
such as group, Individual, children, etc. 

Identify common problems for which spe- 
cific types of tests are used to collect 
data. 

Identify the conditions under which 
various tests are commonly given. 

Dlscyss how certain external conditions 
may affect administration or outcomes. 

Differentiate "Instrument administration" 
from "testing," as It Is commonly used 
(general clarity of all those definitions) 
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Discuss the Issues of prc 
subjects In experimentation, cotmden- 
tlallty of data, subject awareness o§ 
a test situation, etc. 



ra-teet4on of 
tlon, cotrfl3er 



Explain how affective considerations, 
such a rapport, might Influence tes- 
ting process and results. 

Given an experiment, discuss the kinds 
of measurements which would be appro- 
priate! for' data collection. 

Define the major an^Ucbnimon terms asso- 
ciated with experimentation, such as 
^'research design," "depended and Inde- 
pendent variables," "conti^igroups ," 
"hypotheses," "random sampling," "signi- 
ficance, ""confounding ," and "Intervening 
variables ," etc . 

Identify some of the common areas of 
education In which basic research 
occurs. 

l5lscuss the role of, basic experimentation 
In educational R&D. 




- 50 - 



I 



/ 






19 



Objectives 

Data Analysis 

State the characteristics of and give* 
examples of data that are based on 
nominal, ordinal, interval, and 
r^tio scales* 

Describe procedures for. organizing 
data such as^'tallying frequencies or 
ratings, alphabetizing, rank ordering, 
etc. ^ “ 

Given specific types of data, prepare 
an organizational format* 

Identify various types of data display^\ 
such as pie charts, bar graphs , histo- 
grams, etc* 

Stat^^^^ncral guidelines for the prepara- 
tion and construction of visual data 
prtesentations * 



Given an organizational format containing 
specific types of data, prepare a visual 
display such as chart, ^graph, etc* 

Compare and contrast the amounts and 
kinds of information provided by dif- 
ferent data displays*^^ 

Define basic statistical terms such as 
normal distribution^ stan||^rd scores, 
measures of central tendency and dis- 
persion, norms, derived scores, confi- 
dence interval. Type I and Type II 
error, significance, etc* 

Compute dommbm statistics such as mean:; . 
standard devi^ioi^.'t * s , etc* 

State what questions various tests of 
significance address themselves to. 
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Objectives 

Proposal Preparation 

Plan research studies using defensible 
statistical techniques and research 
designs. 

Be familiar with basic concepts of 
research design (eg. random sampling, 
pre- and post-testing, control groups, 
etc.). c 

Identify a variety of funding sources 
and describe the kinds of R&D efforts 
typically funded by each (whether RFP 
or unsolicited or both; what special 
areas of Interest, eg. voc. ed», etc.) 

Estlmat;e the number of manhours needed 
to complete specified tasks. 

Prepare statements describing agency 
facilities and personnel relevant to 
the project proposed. 

Define, describe the distinctions 
between, the following terms; proposal 
prospectus, bid, .RFP, letter of Interest* 

Given an RFP, Identify the topics which 
must be covered in the proposal according' 
to the specifications. 

Write a clear statement of the problem 
your proposed project is addressing. 

State the objectives and anticipated 
products of a proposed project. 

Given a project, identify the kinds 
and sources of data to be collected and 
specify appropriate methods fdr collec- 
ting the data. 

Product Development 

Design, produce, and validate effective 
instructional materials 
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Product Development (cont.) 



Identify sources of information on 
available materials. 

Review and examine existing products 
for relevance to current product effort.- 

Identify elements of the current product 
effort which will need to be 1) adopted, 
2) adapted or modified, and 3) developed 
or dreated. 

Specify the objectives of the product. 



Make constructive recommendations -for 
changes in the product based on field 
test data* 

Identify sources of information regar- 
ding the content of the product. 

Prepare detailed specifications regar- 
ding product development or modification 

Know procedures for ordering/obtaining 
materials to be adopted/adapted. 

Know when copyright or patent releasd^ 
need to be obtained and how to obtain 
them. 

Identify characteristics of product 
users which will have implications 
for pro^ct development (eg. reading 
level >^tc . ) 

Establish quality-control pr'icedures . 



Identify sources of assistance in acti- 
vities your agency is not qualified to 
carry out (eg. printing, photography 
etc . ) 
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Skills you 
would like 
to emphasize 
in balance 
of program 



Evaluation 






X 






Understand distinctions between forma- 
tive and summative evaluation* . 

or 

Understand common planning and evalua- 
tion approaches such as PERT, PPBS, 

CIPP, etc* 

Given a set of objectives, identify 
appropriate methods or techniques 
for assessing whether or not the objec- 
tives have been met (eg, observation, 
interview, test, unobtrusive measures, 
affective measures, etc*) 

Identify examples of "unobtrusive 
measures*" 

Understand the meaning of such concepts 
as: confounding variable, intervening 

variable', error of measurement, sampling 
error* 

Prepare a detailed plan for field testing 
a product. 

Identify the kinds of information to be 
gathered in a field test* 

Identify objectives of a product if not 
previously specified* 

Be familiar with basic design concept^^ 



Specify conditions under which evalua- 
tion data should be collected* 

Identify necessary arrangements to be 
made in carrying out evaluation plan* 

Prepare report of product evaluation 
effort, including analysis and inter- 
pretation of data collected* 
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Objectives 
Evaluation (cont.) 

Specify procedures for analyzing the 
data. 

Perform item analyzes of evaluation 
measures /instruments . 

Specify revisions to be made in evalua- 
tion plan/ instruments based on their 
initial use. 

Marketing > Dissemination, Implementation 

Given a variety of products, identify 
appropriate marketing outlets/dieaemina- 
tion modes for each. 

o 

Identify the target audience to be 
reached. 

Given a variety of target audiences, 
identify appropriate marketing outlet/ 
dissemi<pation modes for each. 

Identify various methods of "advertising** 
a product: eg. news releases, newsletter, 
journal articles, ads, demonstrations, 
mailings, APA, AERA, etc. 

Know when and how to gets, copyrights or 
patents* 

Develop simple market test plans. 

Outline variables to be considered to 
determine if product is ready for imple- 
mentation (eg. necessary instructions 
for use developed, i^ackaging specifica- 
tions prepared, etc.). 

Identify materials/information necessary 
to conduct marketing campaign. 

Identify characteristics of target audi- 
ence to be considered ^n preparing 
specifications. 
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Obj ectlves 

MarketlnR, Dissemination, Implementation 
(cont.) 

Sp.ecify procedures for assessing effec- 
tiveness of marketing, implementation 
effort. 

Write-Up and Publication 

Prepare abstract of project report. ^ 

Be familiar with APA manual on style* 



Write succinct descriptions of the 
purpose, method, results, and impli- 
cations of a project. * ‘ 

Given a variety of specrfic paper 
topics, identify a) appropriate pub- 
lication sources, and,b) appropriate 
oral presentation forums for each. 

Given a draft of an article, or a 
report, review and critique it for 
1) content,. 2) style, and 3) tech- 
nical soundness* 

Schedul ing /Management 

Estimate number of man hours neces- 
sary'^to complete specified tasks. 

Estimate costs associated with com- 
pleting specified tasks* 

Write detailed job description for 
(assumed) vacancy* 

IntervJ.ew candidate for job portion* 



Outline methods for planning, monitoring, 
and evaluating accomplishment of tasks* 

Identify work objectives 
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Objectives 

Scheduling /Management (cont.) 
Prepare progress reports. 



Set',jUp systems for documenting 
■^project progress. 

. Apprenticeship Experiences 

To know and be able to adcess appropriate 
knowledge and information sources. 

To organize and manage data collection 
procedures. 

To assist in the codification, analysis, 
and presentation of data and information. 

To design and specify the requisite tasks 
for an area of materials development. 

To organize, coordinate, and manage the 
production of developmental materials. 

^ To make substantive content or idea 
input to materials development. 

To develop, under super^sion, draft 
materials. 

To be a constructive partner in the 
review of RFP*s, and the development 
of proposals. This requires familiar- 
ity with Federal sources and processes, \ 
and familiarity with such documents as 
the Commerce-Business Daily. 

Exhibit reliability and dependability 
itl finishing an assigned or assumed task 
when it is needed. 

Be thorough in the collection, investiga- 
tion, and presentation of data and other 
types of information, such as literature 
reviews . 
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Objectives 

Apprenticeship Experiences (cont.) 

Assume responsibility for, and take 
seriously, the adequate completion 
of a task. 

Be sensitive to and compatible with 
the surrounding work style, customs, 
and environment. 
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APPENDIX B 

^ GROUP ACTIVITIES AMD ASSIGMMEMTS 



Note; The program was structured to Include many group activities in the 
first half of the program and .few in the second half. By the 
second half of thje program trainees had a clear picture of their 
own objectives and were heavily involved in.’ individual study and 
apprenticeship work. 

Week of September 12 

N * ■ » 

Wednesday - First day of program 

A.M. - Informal introductions, coffee and donuts 

Lecture seminar conducted by Melnotte and iMillstein. 
Introduction and overview of the program 
, Overyie\> of educational research and development in general » 

Tour of AIR plant and facilities 
Lecture - seminar (Melnotte) 

An overview of all educational R&D projects AIR is currently 
working on. . ^ ^ 

^ P.M. - Group Luncheon ' / 

Lecture - seminar (J. Dunn) 

AIR in the broader context of educational R&D 
» Lecture - seminar (D. Tiedeman) 

Formal welcome to\ the program.' 

Discussion of AIR’s objectives and future role in R&D. 

; »» ■ ; ^ 

Thursday . - September 16 - 

A.M. ~ Lecture - seminaf (Melnotte) 

Completion of overview of educational R&D projects XiR is 
currently involved in. 

Assignment of office space. i 

P.M. - Informal group luncheon ^ ' ' ' 

O /V , * 

Presentation of kinds of apprenticeship positions available 
(Millstein) . Trainees provided reading materials describing 
contracts on which apprenticeship positions ,are available. 

I ^ Trainee^ begin thinking about what kinds of projects they 

are interested in working on. They have several weeks before 
decisions need be made, however'. 

o 

.• 

Friday September"^!? 

Topic - in-depth analysis of the kinds of skills involved in 
educational R&D. Project PLAN taken as a comprehensive 

example. “ 

. ' . ■ i 

^ A.M. - Film on Project PLAN . 






c • 






P.M. - 



Individual study of several articles on Project PLAN. 
Flanagan, J. C,, How Instructional Systems* Will Manage 
Learning. 

Flanagan, J. C,, The Role of the Computer in Project PLAN. 
Dunn, J, A,, The Accommodation of Individual Differences in 
the Development of Personal Programs of Study, 

Lecture - seminar (J, Dunn) 

On ^the kinds of skills required in a comprehensive educa- 
tional R&D project such as PLAN, ^ , 




Week of September 19 

Note: ^ days when there are no formal group 

activities, trainees are involved in individual study of. both -general an^ indi- 
vidual assignments, 

Monday - September 20 

• P,M, - Lecture - seminar (L, Steel) 

The DDE project - a project designed^ to create instructional 
V ^ materials to train personnel for educational development, 

'dissemination, and evaluation. 

Overview of the modules trainees will study, 

. 4 Assignment - Module 2-2-4, Data Analysis , 

Module 2-2-3, . Data Management , 

Dual purpose of assignment: 

1) to^learn the content of the modules 

2) to'’ test and male contribution toward revision and improve- 

ment of the m;.)dule, 

September 24 * 

Lecture - seminar (J. Dunn) 

Data collection with young children. 

Short film of a child working on a block-sort task, 

Optional assignment- Dunn, J,, The OST: Theory, Instrument,’ 

ami Norms. 



Friday 

A.M, 



\ 



r 



Week of September^ ^6' 

Sunday - September 26 

P.M, - Informal dinner for trainees and sta^f at project director’s house, 



Monday 



A.M. 



P-.M, 



- September 27 * 

Topic - Behavioral objectives ^ 

-r Assignment - Read Mager, R,, Preparing Instructional Objectives . 
Write thuee properly^ formed behavioral objectives. 

Critically analyze 10 project PLAN behavioral objectives 

Seminar discifssion (Mills tein) 

Behavioral objectives, . 
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Wednesday 



A.M. - 



Thursday 

P.M. - 



Friday 



A.M. - 






September 29 

Topic - Programmed Instruction 

Film: Markle, D., Programmed Instruction, The Development 

Pr^^cess . 

Assignment - Markle, S., Good Frames and Bad . 

September 30 ’ ^ 

Seminar (Millstein) . 

Programmed Instruction^. 

October 1 ^ . 

Topic - Computer-assisted instruction (C.A.I.) 

Field trip to the Brentwood School - an elementary school in 

a black neighborhood with sophisticated *<]. A. I . system. Included 
^ round-table discussion with the principal- and three teachers 
and a tour of the C.A.I. system while in use. 



“P.M. - Informal group luncheon 



Lectui'e - seminar (Millstein) 

C.A.L. * / 



Week of October 3 ^ 

Monday ^ - October 4 

* • > * 

Topic - Incentives and Accountability 

A.H. - Assignment - Read Jung, S.M.; Lipe, D.; and Wolfe, P.S. 

Study of the Use of Incentives in Education and the .Feasibility 
of Field Experiments in School Systems . 

P.M. - Lecture - seminar (S. Jung) 

Incentives and accountability. 

' \S^ ■ - 

\ 

Tuesday - October 5 





Thursday 

Friday 



Assignment - Preparation for attendance at professional confer- 
ence to be held at AIR on Thursday and Friday. Read Computer 
Based Vocational Gu-idance Systems . . Summary of papers presented 
at the Fourth Symposium for systems under development for 
vocational guidance. 



October 7 
October 8 




Trainees attended the Eighth Invitational Conference on Systems 
Under Construction for Career Eduction and Development. Papers 
•at the conference included : ^ 

^ 1 ) models for career education and 

reports on^ status and progress of various guidance systems 



Week 'of October 10 



Monday 

A.M. 



I 



Tuesday 

P.M. 



October 11 

» ’ 

- Film: Harris, J., Project CVIS i 

Seminar (Mills tein) _ * ’ , 

Trainee reactj.bns, comments, etc. ^ on the Career Education 
and Development Conference. 

October 1’2 ^ 

Lecture - seminar (D. Lipe) 

Behavior Modification . 

Assignment - Read Holland, J. and Skinner, B.F, - The Experi- 
mental Analysis of Behavior . ‘ « 



Week of October 17 



Sunday 
' P.M. 



“ October 17 . ' 

- Meeting at 8ne oi^ the trainee’s houses to watch Skinner on 
educational television. 

Discussion followed the program. . 



Tuesday ^ - October 19 



. P.M. •“ Seminar - discussion (M. Ausloos) ' ^ . 

Conducted by one of the « trainees dfi the proposal evaluation 
procedures, for small grants from OE. This trainee had 
attended a proposal evaluation meeting for the Western states. 



Week of October 24 ^ " 

Entire week spent in individual activities. No group activities, 



Week of October 31 - ' v 

Tuesday' - ‘ Nbvember 2 *•' ^ 

Field trip, to Educational Testing Service, in Berkeley., 
Round table discussion with ETS staff members. Tour 
of facilities.' 



Week of November 7 



Wednesday 



A*M. 



Thursday 

P.M. 



\ 



“ November 10 * . . 

^ Ca ^ 

- Discussion and workshop by trainees on how to ^revise and 

improve Data Management , one of the modules being de- 
veloped f Olathe Far West Consortium for DD&E' Training. ' 

- November 11 . ' ' • • = 

- Discussion on how to rewrite resum.es to reflect skills "and 

•i experience relevant to educational R&D. • 






Week of November 14 



\ 



Wednesday •“ November 17 - 

P.M. Seminar discussion on job hunting strategies. 

. ^ i 

Friday - November 19 

P.M. r Informal dinner party at the home of one of the trainees. 




Week of November 21 

Monday . November 22 

A.M. - Trainees from the Seattle a?ea met with an AIR sta^f' 

member from the Pacific Northwest to discuss job 
possibilities ^in that area. / 

Week of November 28 \ 

No group activities. Trainees involved in independent study, appren- 
ticeship tasks, and independent study. 

Period of December 5 - 1§ 

Wednesday December , 8 

A.M. Second group discussion on job hunting strategies. 



. Monday 



A.M. 



- December 13 
Examination 
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APPENDIX C 

INDIVIDUAL ACTIVITIES OF TRAINEES 






Trainee - M. Ausloos 






September 15 - September 24 



Weisgerber^ E. Norris) 



Met with various professionals at AIR (R. 
to discuss environmental education. 
iMet with U. Dunn to discuss the format for writing a proposal. 

Arranged and attended meetings at the Hancock Foundyation, 
‘Sunnyvale and San Jose school districts and DeAnza Community 
College in order to plan a \ oposal on envlronmeiital education. 
Began writing propo3al on environmental education to be sub- 
mitted by DeAnza College to’ the Hancock Foundation. Is 
serving his apprenticeship at DeAnza College, j 

Week of September 26 

Home sick with the flu. / 

Week of October 3 j 

t 

Continued, writing proposal on environmental jfeducation to be 
submitted to the Hancock Foundation. 

Read parts of the symposium on Computer-based Vocational 
Guidance Systems. . ’ 

Week of October 10 i 

Arranged and attended meetings at Brentwood school, Stanford, 
and DeAnza to discuss computer^ assisted instruction and 
environmental education. 

Attended and observed the proceedings of the U.S. Office of 
Education, Region 9, small grants review panel in Reno, 

Nevada . 

Read Mager, R., Preparing Instructional Objectives . 

Reviewed : Annual register of grant support 1970 . 

The Foundation Directory . 3rd. ed. 
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Week of October 17 



Completed writing proposal on environmental education. 

Arranged written endorsements of proposal by local school 
districts . 

Assigned office space in DeAnza College where he is serving 
his apprenticeship. Began research for his supervisor there 
the evaluation of educational administrators. 

Presented a lecture - seminar to other trainees on the small 
^ grants review panel procedures witnessed at the meeting in 
Reno. 



Read: Flanagan, J.C. & Miller, R.B., Introducing the perform- 

ance record program; the critical incident method for 
employee' appraisal and development . 

Fleishman, E.A., ed. Studies in personnel and industrial 
psychology . 



Week of October 24 - 30 






Continued research and review of the literature for DeAnza 
College on the evaluation of educational administrators. 

Read about Flanagan’s critical incident method for possible 
application to this issue. 

Checked on final procedures for submitting environmental 
education proposal to the Hancock Foundation. 

Attended' a meeting on job opportunities under the Emergency 
Employment Act . ‘ ‘ 

Week of October 31 - November* 6 . ^ 

Continued work on his ap^enticeship at DeAnza College. Tasks 
» included the following: 1) Reviewed the DeAnza economic 

model. The model is intended to offer an analytical approach 
to the most economic number students plan for in each 
of the apnotiincred classes. . 2) Reviewed a California bill 

■ which may enable DeAnza to offer a new series of courses in 
nursing. 3) Attended an Office of Education meeting in 
San Francisco. TJie purpose of the meeting was to explain 
the administration of funding for environmental education. 
Briefed DeAnza officials on the meeting. 5) Attended a 
meeting relating to the availability of Emergency Employment 
Act funds for DeAnza College. 

Week of November 7-13 

Participated in an environmental conference related to his 
interest in environmental education. 

Continued work on apprenticeship at DeAnza college. 

Read the Hawaii English Program 

Attended two job interviews. - , 









Week of November 14 - 20 



Continued work on apprenticeship at DeAnza College, Conducted 
research into an evaluation model* for the DeAnza Mini 
College Program. 

Week of November 21 - 27 - 

Continued work on apprenticeship at DeAnza. 

Week of November 28 - December 4 




Travelled to Wisconsin and South Dakota for job interviews. 

Both were with the S^te Department of Public Instruction, 

( 

Period of December 5 - 15 , 



Completed apprenticeship ta^ at DeAnza Community College. 

Has taken a job as Coordinator of the Work Experience Program 
at Gavilon Community College. 



Trainee - B. Berger 




September 15 - September 24 

Read: Ba*ckg;round materials on the Oak Grove Project. 

A; number of sociological studies which serve as examples of- / 

' problems whicl^ could be investigated using the Talent Data 
, Hank. Studies' included: 

. Pavalko, R.M., "Recruitment to Teaching: Patterns of 

V Selection and Retention" 

Sewell, H. and Shah, P., "Parents Education and 

Children's Educational Aspirations and Achievements" 

Sewell, W. H., Haller, A.O., and Portes, A., "The 

Educational and Early Occupational Attainment Process" 

Sewell, W.H., "Essay Review: The Social Context of 

Ambition" 

Pavalko, R.M., "Aspirants to Teaching; Some Differ- 
ences Between High School Senior Boys and Girls 
. Planning on a Career in Teaching" 

Sewell, W.H., Armer, J.M. , and Shah, V.P., "On Neighbor- 
hood Context and College Plans (1) , (II) , and (III) and 
Reply to Turner, Michael and Boyle" 
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Sewell,* W.H. and Armer, J.M., "Neighborhood Context and 
College Plans" 

Coleman, J.S., Campbell, Hobson, McPartland, Mood, 

Weinfeld, York, "Equality of Educational Opportunity" 

DDE module on Data Analysis 

Huff, D., How to Li^With Statistics 

Silberman, CrisjLs in the Classroom 



Week of September 26 

Read: Mager, R,, Preparing Instructional Objectives 

Dillman, F., Instructional Objectives: Specificity 

and Behavior 

Markle, D., Good Frames and Bad 
Continued studying Data Analysis Module. 



Week of October 3 

Read; Jung, S.M. , Lipe, D., and Wolfe, P.S., Study of the Use 
of Incentives in Education ana The Feasibility of Field Experi- 
ments in School Systems . 

. ' Education Turnkey System, Perfomance Contracting in Education. 

Symposium on Computer-based Vocational Guidance Systems. 

Week of October 10 

Read: Crawfprd, J. et.al.. Selection and Description of Educa- 

tional Products for a Study of the Development and Impact of 
Such Products . 

Jung, S.M., et.al.. Product Development Report: First Year 

Communication Skills Program . 

Read in preparation for work on this project in the coming weeks. 
Holland, J. and Skinner, B.F. The Analysis of Behavior . 
Education for the Urban Disadvantages from Preschool to 
Employment . r 

Lessinger Every Kid a Winner; Accountability in Education . 
Began working on an AIR project designed to examine the process 
of development of successful educational products. She is 
analyzing and summarizing material on the development of the 
Distar System. 









Week of October. 17"- 23 

Read: Chapters 1-17 of Holland, J. and Skinner, B., The Analysis 

of Behavior . 

Chapters 1-7 of Skinner, ^F., Science and Human Behavior . 
Began The Urban Institute's Federal Evaluation Poli(^: 

Analyzing the Effects of Public Programs 
Continued work on AIR project to examine the process of d^elop- 
ment of successful educational products 
Completed Data Analysis module test. 
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Week of October 24 - 30 



Continued work on AIR project' to examine the process of 
development of successful educational products. 

Read: Oettinger, A., Run Computer, Run . 

Continued reading: Skinner,* B.F., Science and Human Behavior. 



Met with two other trainees to discuss improvements of the 
Data Analysis module . 



Week of October 31 - November 6 






r 

\ 






Continued work on AIR project to examine the process of 
development of successful educational products. Began 
work on an external apprenticeship at Foothill Community 
College District. Met with off icials including the 
"director of business services. Will work on the five 
year financial plan, particularly student enrollment 
predictions. 

Read: Fleishman, A. A Study in Human Communication. 

Scientific Activities of Independent Non-profit Research 
Institutions , 1970 . 



Week ofyNovember 7-13 



Continued work on Community College apprenticeship—Five 
Year f^an ^ ^ 

Continued work on AIR project to examine the/process of 
development of successful educational products.^ \ 
Read: Federal evaluation policy-^analyzing the effect 

public programs, 1970. * 

Continued reading: Skinner, B.F. Science and Huma n 

Behavior. 



s of 






Week of November 14 - 20 



Continued work on the two apprenticeship tasks . See above. 
Read: Gilmore, J.S., Ryan, J.J., Gould, W.S. Defense 

Systems Resources in the Civil Sector; An Evolving Approach , 



An Uncertain Market 



Wood, D.A. Test Construction ; 
tation of Achievement Tests. 
Revised resume. 



Development and Interpre- 



Week of November 21-27 » 

Began writing her report for AIR project to examine the prq^ss 
of development of successful educational products. Met with 
staff members working on this project. 

Met with staff member Jack Crawford to discuss job leads in the 
Pacii’ic Northwest. 

Read: Cronbach, L.J. Essentials of Psychological Testing . 
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Week of November 28 - December 4 



Trainee 






Continued writing her report for AIR project to examine the 
process of development of successful educational products. 

Met with all staff ' members working on this pr&ject. 

Period of December 5-15 \ 

Completed work on both apprenticeship tasks. Subkitted reports. 

J. Dervin 

September 15 - September 24 

Taking a course in educational psychology at San Franhisco State 
' Read: Flanagan, et.al.. Design for a Study of American Youth 

Flanagan.^ individualizing Education 
Flanagan, The PIAN Educational'- System . * 

Dunn, The PLAN Approach to Curriculuni Development 
Duffy, Advantages of the Clinical Professor • 

Dunn, Development of Procedures for Individualization of 
Educational Programs. 

Week of September 26 . * - / ' 

Read: Mager, R. Preparing Instructional Objectives 

Markle,. D. Good Frames and Bad 
Dillman, F. Instructional Objectives 
Specificity and Behavior 

Flanagan, J. Design for a Study of American Youth ^ 

Symposium on Computer-Based Vocational Juidance Systems 
Jung, S., Study of the Use of Incentives 
Parents magazine issue on "rebirth of education" 

Week of October 3 

Began work in an AIR project on employer-based career educa- 
tion. Worked on the literature search and review in the 
area of student goal formulation. 

Read: Lennon, A Glossary of 100 Measurement Terms in- Test 

Service Notebook //13. 

Dunn, J.A., The OST: Theory, Instrument, and Norms 

Steel, L. , Data Management Module 
Hilgard, Theories of Learning 

Simon and Newell, Elements of a Theory of Human Problem 
Solving. 

Week of October 10 

Continued work on literature review for employer-based 
career education. • 

Did a small amount of work on another AIR project - Develop- 
ment of a system for evaluating regional educational^l^bor- 
atories and educational R&D centers. Did proof reading and 
some editing. 
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Read: Buckley, Modern Systems Research for Behavioral Scientists . 

Jensen, Intelligence, in Harvard Educational Review. 

Retorts to Jensen by several authors. 

Piaget, The Science of Education 

Miller, Living Systems: Structure and Process. 

Week of October 17 ^ t 

Continued work on the Data Analysis module. 

Read: Holland & Skinner, An Analysis of Behavior 

Skinner, BehavTojrism at Fifty 
Miller, The Nature of Living Systems 

Livesey, A Consideration of the Neural Basis of Intelligent , 
Behavior - ' . * " 

Hare , Computer Simulation of Small Group Processes 

Miller, Galanter, Pribam, Plans arid the Structure of Behavior 

Week of October 24 - 30 , . , ' 



Home sick most of week. . o 

Read: Kelley, E.C., The Fully Functioning Self. 

Continued reading: Holland, J. & Skinner, B., The Analysis 

of Behavior . J 

Worked on Datd Analysis module. 

Week of October 31 - November 6 . ' 

Began work on apprenticeship assignment. AIR project coopera- . 
tive Longitudinal Study of Demonstration Education Programs. 

1 IhlLiaT asslgiiment ; l)~Put together, three questionnaires for 
parents and teachers of children in the study.. 2) Design 
format. 3) Write instructions. 4) Determine procedures for 
follow-up. 5) Decide what incentives should be used. 

Continued studying: Steel,' L. Data Analysis . 

Holland , J . and Skinner , B .F . Analysis of Behavior . 

Read: Rogers, Freedom to Learn ' . 

Gagne, Human Functions in Systems 
\ Maslow^ Basic Propositions of a Growth and Self-Actualization 
^Psychology . 

Week of November 7-13 



Continued apprenticeship work on AIR project — Cooperative 
Longitudinal Study of Demonstration Education Programs. 
(See Week of October 31) 

C(#ntinued studying: Steel, L. Data Analysis . 

Rogers, Freedom to Learn." 

Began reading*: Holt, J. How Children Learn . 

Holt, J. How Children Fail . 

Hunt, J. Impact of^he Giant in Developmental Psychology. 



Week of November 14 



20 



Began work on second apprenticeship task. Research and present 
information on soqrce of funding, nature of studies, and pro-t 
posal due dates. > 
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Continued work on apprenticeship task for AIR project — Coopera- 
tive Longitudinal Study of Demonstration Education Programs. 
Completed reading: * Holt , J. How Children Learn 
Holt, J. How Children Fail 
Rogers, 

Ottina, 



Small Projects of the Regional Research Program. 
Highlights of O.E.*s 1972 Budget. 



November 21 - 27 

Q 

Completed work on apprenticeship task — sourced , of funding. 
Continued apprenticeship work on the Cooperative Longitudinal 
Study of Demonstration Education Programs. ^ 

Read: Spence, ElemenfarV Statistics 

Huff,D. How to Lie with Statistics 
Weinberg, Inferential Statistics 
Revised resume and sent copies to four organizations (listed 
in Appendix 0) 



Week of November 28 - December 4 









Continued apprenticeship worl^on Demonstration Education Study. 
Read: Lipe, D. and Jung, S. Manipulation of Incentives to 

Enhanqg Learning. 

Pucel, The Effectiveness of /Incentives in Maximizing^ 
Questionnaire Returns 
Clarke,' Statistical Procedures 
^ Flanagan, jT] The "ciritical Incidents Technique 
Sent resume copies to two more organizaticans 

Arranged job interview with the California Advisory Council for 
Vocational and Technical Training, Sacramento. 



\. 

' h 



Period of December 5, - 15 



7 



^Completed Apprenticeship, work, on the Longitudinal Study of 

Demonstration Education Programs. 1) Three questionnaires / 
were \J[ritten.‘ 2) Cover letters were written. 3) Follow-up 
. procedkrea were devised. 

Worked oA a third apprenticeship taski Assisted in the develop- 
ment or^-ar"^classif ication system for educational R&D products 
£or an AIR contract with O.E. 

.Completed reading: Steel, L. Data Analysis . 

Read : Piaget , The Science of Education and the Psychology 

of the Child. 

Sawin, Observing and Interviewing. ^ 

Tyler, Test and Measurements. 

Sent resume to twelve more organizations in the Bay area. 
























rainee - W. Keehn 



September l5 - 24 




Read or reviewed: Gagne, R., Contributions of Learning to 

. Human Pevelopment 
Skinner, B., Cumulative Record 
Silberman, ‘ Crisis in the Classroom 
Talent, ife^gn for a Study of American. Youth 
• Data Management moduTe ^ 

Miscellaneous Talent documents 

Bloom, Problem-Solving Processes of College Students 
Bartlette, Thinking ^ 

Bruner, et.al., A Study of Thinking 
Russel, Human- Kndwladg^ 

Simon and Newell, Human Problem Solving 

Hansen, The Effects of Training on the Cognitive Development 

of Nursery School Children. ^ 

• « * 



Week of September 26 

Reaci or ^viewed; Mager, Preparing Instructional Objectives 
Dillman,, Instructional Objectives: Specificity and Behavior 

Markle, S., Good TErames and Bad ^ 

Guilford, Intelligence Has Three Facets 
Jung, S.M., et.al., A Study of the Use of Incentives in 

School Systems , * 

. Dewey, How We Think 

Began work on an AIR project to write a position paper on 
v-^ employer-based career education. 

Read background materials. / 



J 




Week of October 3 

Read or Reviewed; Skinner, B., Teaching Science in High School 
Lessinger, Every Kid 'a Winner 

Sypbsium on Computer-Based Vocational Guidance Systems 
» A Study of Our Nation 's'^ Schools in Harvard Educational Review 
Berg , Education and Jobs * 

Continued work on AIR’s project in employer-based career 
education. Wrote one section of this report. Coordinated 
information among the writers of other* sections. 

Week of October 10 

Read; Miller, Learning of Visceral and Glandular Responses 
' DeCora, Learning in the Autonomic Nervous System 
Co^ntinued work on AIR’s project in employer-based career educa- 
' tion. -Writing and coordination of sections of the report. 

Week of October 17 , 

Read or Reviewed; Postman and Weingartner, Teaching as a 
Subversive Activity 

Williamson, The Inquiring School: A *Study of Educational 

" Renewal . 

Continued work on AIR^s project in employer-bas^d career education. 



# 

I 
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Week of October 24 ~ 30 



Delivered employer-based career education papers to Far West 
• Lab and spoke with Bela Banathy.' Banatky asked him to subm 
his resume. 

Worked on WIN proposal. Helped prepare parts of the proposal 
and superyised final production. 

Began work on a personal position palmer. The theme is that 
education must emphasize problem solving skills. 

Read or reviewed; Shaw, Parents and Children. 

Wildiamson thesis ’ 

PLAN objectives 

Wertheimer, Productive ^Thinking 

Russell, Human Knowledge > - ' 



' Continued work on his positipn paper; Theme — education must 
emphasize problem* solving^ skills . 



program. . , ' 

Revised resume 

K Read or reviewed: Gregory, The Intelligent Eye 

Simon, ^ Science lof the Artificial 

Bloom, Stability and Change in Human Characteristics ^ 

Studied : Steel , L . Data Analysis 

Week of November 14 - 20 . 

•> . - o . ■ 

o 

Proofed and rewrote minor parts of position paper (see Week of' 

. ' October ’24-30) Discussed position paper with D. Tiedeman 
and J. Melnotte. . 

Began work on another apprenticeship task. He will assist in 
the development of a taxonomy of knowledge and developmental 
products for an AIR project to develop a model for evaluating 
regional educational laboratories and R&D centers. 

Read or reviewed: Flanagan, J.C.^. Personnel Psychology , a 

Twenty Year Program. Report on Higher .Education . 

Flanagan, J.C. , Studies of the American High School 
Shaycoft, M. The HjLgh School Years . 

Week of November 21-27* ' * . 



Met with J ssitiiitdes in ^che Pacific 

NorthwesL. . . • . 



Week of October 31 - November .6 



Examined : Educational Development and Research Catalogue 



(May 1971 ) 



r . 



Week of November 7 13 



Completed work on his position paper /(see Week of October 24-30) 
Wrote long memorandum on his reactions to the cross-training 



Continued 

developm 




taxonomy for knowledge and 



November 29, ,1971 












Left the program to take a temporary full-time job at the ' 

Far West Laboratory for Educational Research and Development. 






Trainee' - N. Lurowist 



Seotember 15 - September 24 

^ , 

Read an RFP, on a voucher plan. Helped prepare the schedule 
of activities for the voucher proposal. 

Began Dat»a Analysis module ^ . ' . 

Read several articles on PLAN , [ 



Weekjlof September 26 

Read: Mager, R., Preparing Instructional Objectives 

Dillman, F., Instructional Objectives: Spe^JLficity and 

Behavior 



Markle, S., Good Frames and Bad 
Jung, S., et.al., Study of the Use of Incentives in Educa- 
tion and the Feasibility of Field Experiments in School 
■ Systems . * . 



y 










Week of October 3 * 

Read: Approximately half of the Symposium on Comp\iter-Based 

Vocational Guidance Systems 

Week of October 10 

Read: Six Chapters of Holland, J. and Skinner, B., The 

Analysis of Behavior 

. Began work on an AIR project to develop a system for evaluating 
^regional educational laboratories and centers. Helped define 
and explain evaluation criteria J.isted in a form to be com- 
pleted by evaluation judges . 

Read Persell, Quality, of Research Education 

Week of October 17 - 23 

Continued work on AIR project to develop* a system for evaluating 
regional educational laboratories and centers . 

Arranged to work on a project at the Ravenswood School District. 
Will work on training of teachers in the use of the computer 
in education. 

• - . * , ® 

Week of October 24-30 





Worked on WIN proposal. Prepared schedule and man-hours 
analysis . 

Continued work on computer^edUi^ation at Ravenswood school 
district . . ** * 

Met with two other trainees to discuss improvements of the 
Data ^Analysis module. 

Continued work on AIR project to develop a system for evalu- 
ating regional educational laboratories and centers. 

Read; Chaper in Network Analysis book. 
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Week of October 31 - November 6 

Continued work on both apprenticeship projects. (See Wfeek of 
October 17-23.) ^ 

Week of November 7 -- 13 * ^ 

Continued work on both apprenticeship projects (See Week of 
October 17-23.) 

Studied ; Sawin , E . Observing and Interviewinjg . 

Week of November 14-20 

Continued work on both apprenticeship projects (See Week df 
^ctober 17-23.) ' V 
Revised resume. ' ^ 

^Week of November 21-27 “ 

Continued work on both apprenticeship projects (See wkek of ’ 
October 17-23.) "" 

Conducted an ERIC search. 



Week of November 28 - December 4 



3 






Began .work on a new apprenticeship project. He will assist 
_ in the development of a self-instructional module for /the 
Far West Consortium for Development, Dissemination, and 
^ Evaluation Training. The module is entitled Introduction 
to Component Design. 

Continued, apprenticeship at Ravenswood School DistrictT- 
training" teachers in the use of the computer in education. 

Period of December 5-15 

Continued work on two apprenticeship ^^qjects. (See Week of 
November 28.) 






Trainee - N. Mattson 



September 15 - September 24 ^ , 

Read a number of sociological studies which serve as examples 
of problems which could be investigated using the Talent ‘ 

Data bank. The papers include: . ' 

• Pavalko, R.M., "Recruitment to "Teachinjg: Patterns of 

Selection and Retentipn" 

Sewell, W.H. and Shah,* V.P. , "Parents ..Education and 
Children’s Educational Aspirations and A'chievements" 

' Sewell, W.H., Haller, A.O,, and Portes, "The Educational 
and Earlys Occupational Attainment Process" 

Sewell, W.H., "Essay Review: The Social Context of Ambition" 

/ • 



ERIC 
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Pavalko, R.M., **Aspirants to Teaching: Some Differences' 

jBe tween High School Senior ’ Boys and Girls Planning on a 
^ ^ Career in Teaching” , ' / 

SeweJLl, W. H., et.al., ”0n Neighborhood Context and College 
, Plans (1), (II), and (III) and Reply to Turner, Michael, 
and Boyle”. ‘ 

Sewell, W.H.and Armer, J.M., ”Neighborhood Context and ^ 

College Plans” ^ ^ 

Coleman, J.S., Campbell, Hobson, McPartland, Mood, Weinfeld, 
York, ”Equality of Educational Opportunity” 

Read Campbell’s proposal on Televoting 
Read overview of proprietory school study 

Studied the DDE module on Data Analysis { 

Read Silberman, Crisis in the Classroom 

V- 



Week of \^eptember 26 : * . 

Read Mager, R., Preparing Instructional Objectives 

Dillman, F.E., Instructional Objectives, Specificity and 
' Behavior ■ " 

Analyzed PLAN objectives > 

, Studied Markle, S., Good Frames and Bad , k 

Jungi S.M., Lipe, D., and Wolfe,' P*. S., Study of the Use of 
Incentives in. Education and*the Feasibility of Field / 
E xperiments in School Systems ' 



:\ 






Week of October 3 



T 






y ' . 



V 



^eek 













Read: English, A Consortium Thrust ^t Professional Accourft-- 

ability, *Self-Governance, and Educational^ Ref orm 
English, Toward-a Differentiated Teachiftg S.taff 
Computer-Based Vocational Guidance Systems.. Symposium 
Excerpts from Harris, The Computerization of Vocational r .* 
Information. a . " . . \ - 

Excerpts from AIR Report, Development and Evaluation of an 
Experimental Curriculum for the Quincy, Mas^. Voc-Tech 
School * ' ' . 

Excer-pts from Dunn, The Cognitiv,e Process of the Individual 
Cra^iprd, J. , et.al.. Selection and D^cripticn of Educational 
Products for^a Study of the PeveJ^Qpment and Impact of Such 
Products. . . ^ * 

Jung, S.M., et.al.. Product^ Development Report: First Year / 

Communication Skills Program . Read in preparation for work 
on this project in the coming weeks. 

of October 10 

Began working on an AIR project designed to examine the proces's 
of development of successful educational products. He is 
analyzing and summarizing material pn the development of the 
Distar System. s . ' 

Reads Committee for Educational Development Education for the 
Urban Disadvantaged > j ♦ 

Holland, J. and Skinner, B.F., The Analysis" of Behavior \ 

How to use ERip 

Lessinger, Every Kid a_,Winner . 
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Week of October 17-23 



Read: Chapters 1-13 of Holland, J. and Skinner, B., The Analysis 

o f Behavior 

Completed Data Analysis module test 

Continued work on AIR project to examine the process of develop- 
ment of successful educational products . 



Week of October 24 - 30 




Continued work on AIR project to examine the process o^ 
development of successful educational products. 

Continued reading : Holland , J . & Skinner , B. , The Analysis 

of Behavior . 

Began reading: Oettinger, A., Run Computer, Run . 



Week of October 31 - November 6 

Began work on an external apprenticeship at Foothill Community 
College District. Me^ with officials including the director 
of business services. Will work on the five year financial'' 
plan, particularly student enrollment predictions. 

. Continued work on AIR project to examine the process of develop- 
ment of successful educational projects. Began writing report 
on his work in this project. 

Read: Southwest Educational Development Laboratory. Callipers . 

f. 2 ' 

Week of November 7-13* 

Continued work on both apprenticeship projects. (See V7eek of 
October 31 - November 6.) 



Week of November 14-20 

Continued work on both apprenticeship projects. (See week of 
October 31 - November 6.) 'Studied a number of projections 
of student enrollments.. ' . . 

November 21,, 1971 , ‘ 



Left the cross-training program to take a jcb at the Boeing 
Company.^ : 



APPENDIX D 



INSTRUCTIONAL (MATERIALS AND RESOURCES 



This' list contains some of the more important materials used during the 
cross-training program It ^’s- by no means an exhaustive list. For ease 
of use it is organized by several basic topics'; 

Evaluation V.. 

' ' / 

Hawkridge, D.G., Campeau, P.L., & Trichett, P.K, Preparing evaluation 

reports: a guide for authors . Final report prepared under 

contract OEC-0-9-50201 3-2808(099) . Submitted to U.S. Office 
. of Education, U.S. Department |of Health, Education, and 
Welfare. Palo Alto, Californija: American Institutes for 

Research, 1969. 

Sawin, E. Observing and interviewing . Pre-publication draft. Berkeley: 
Far West Laboratory for Educe Lional Research and Development, 
Consortium for Development, Dissemin^ion, and Evaluation - 
Training, 1971. ' 

V * * ■ 

Scriven, M. The methodology of evaluation. AERA monograph series on 
curriculum evaluation I: perspectives of curriculum, evalu- 
ation. Chicago: Rand McNally & Co., 1968. * 



, The Southwest Educational Development Laboratory. Calipers: Planning 

the systems approach to field testing educational products . 
Austin, Texas: Southwest Educational Development Corporation, 

1969. . 

Steel,!. & Caniter, R. A survey of information/data handTiog^activities 
- in educational DD&E . Pre-publication draft. Berkel^: Far 

West laboratory for Educational Research and Develo[^nt, 
Consortium for Development, Dissemination, and Evaluation 
Training, 1971. 

. ,4 C? 

Stufflebeam, D.I., Foley, W.J., Gephart, W.J., Guba, E.G.,- Hammond, R.I., 
Merriman, H.O., & Provus, M.M. Phi Delta Kappa National Study 
. Committee on E-valuation. Educational evaluation and decision 

making . Itasca, Illinois: F.E. Peacock Publishers, Inc., 1971. 

Suchman, E.A. Evaluative research.: Principles and practice in public 

ser vice and social action programs . . New York: Russell Sage • 

Foundation, 1967. 

Wholey, J.S., e;t Federal evaluation policy: Analyzing the effects 

of publ'fF programs . Washington, D.C. : Urban Institute, 1970. 
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Instruction 






Dunn, J.D. The PLAN approach to curriculum definition. Education, 1970, 

^, 221-226. ; 

Flanagan, J.C., How instructional systems will manage learnino. Nation's 
Schools , 1970, 86(4) , 65-69/120. 

Flanagan, J.C. Individualizing education. Education , 1970, 90, 191-206. 

Flanagan, J.C. The role of the computer in PLAN. Journal of Educational 
Data Processing , 1970, 7(1) , 1-10. 

Holt, J.C. How children fail . New York: Pitman, 1964. 

Holt, J.C. How children learn . New York: Dell, 1970. 

Jung, S.M., Lipe, D., & Wolfe, P.S. Study of the use of incentives in 

in education and the feasibility of field experiments in school 
systems . Final,, report prepared under contract OEC-0-70-5025 . 

\ Submitted to Offite of Program Planning and Evaluation, 

U.S. Office of Education, U.S. Department of Health, Education, 

\ and Welfare. Palo Alto, California: American Institutes for 

^ 'Research, 1971. 

Lessinger, L.M. Every kid a winner: Accountability in education . New York: 

Simon and Schuster, 1970, 

Oettinger, A.6. & Marks, S. Run, computer, run: The mythology of educa - 

tional innovation--an essay . Cambridge, Mass.l Harvard Uni- 
versity Press, 1969. 

Postman, N. & Weingartner, C. Teaching as a subversive activity . . New York:' 
Delaconte Press, 1969. 

SiTbermah, C.E. Crisis in the Classroom: The remaking of American 

, Education. New York: Random House, Inc., 1970. 



Psychology of Learning' 

Bloom, B.S. Stability & change in human characteristics. New York: 

Wiley, 1964r 

Bruner, J .S. , GoodnbwT^J .J . and Austin, 6. A. A study of thinking. New York: 
Wiley, 1956. , 

I 

Fleishman, E.A. (Ed.). Judies in pei^sonnel and industrial psychology . 
Homewood, i'l 1 i rroi s : -Dorc^y' Press , 1967 . 

Hilgard, E.R.. (ED.) Theories of leaning an.:! instruction . National Society 
for the Study of Education, Committee on Theories of Learning and 
Instruction. Chicago: University of Chicago Press, 1964. 



o 



Holland, J.G. & Skinner, B.F. The analysis of behavior . New York, 
Toronto, London; McGraw-Hill Book Company, Inc., 1961. 

/ 

Newell, A. & Simon, H. Human Problem Solving. New York: Prentice-Hall, 

1971. ^ 

Piaget, J. Science of education and the psychology of the child . , 

New York: Orion Press, 1970. 

Skinner, 3.F. Science and human behavior . New York: Macmillan, 1953. 

SKinner, B.F. Cumulative record . (Enl. ed.) New York: Appleton- 

Century-Crafts , 1961. 



Proposal Writing 

Crawford, J. & Kielsmeier, C. P roposal writing: A manual and workbook .'^ 

Corvallis, Oregon: Continuing Education Publishers, 1970. 



Statistics 

Campbell, D.F. and Stanley, J.C. Experimental and quasi -experimental 

designs for research . Chicago: Rand McNally & Company, 1963. 

Elzey, F. A first reader- in statistic s. Belmont, California: 

' Wadsworth Publ ishing Company. Inc., 1967. 

Gorow, F.F. Statistical Measures: A programmed Test; Central Tendency , 

Dispersion, Correlation. San Francisco: Chandler Publishing 

T962: 

. y - • 

/ 

Huff, D. How to live with statistics . 'New York: ,W.W. Norton, Inc., 
1954. ' A 

McCol lough, C. & Van Alta, L. Statistical concepts: A program for 

self-instruction . New York, San Francisco: McGraw-Hill 

Book Company, Inc. , 1963^ 

Spence, J.F., Elementary statistics . New York: Appleton- 

Century-Crafts , 1968. 

Steel, L. Data analysis . Pre-publication draf Berkeley: Far West 

Laboratory for Education Research and Development, Consortiuni 
for Development, Dissemination, and Evaluation Training, 1971. 



Test Construction 



Cronbach, L.J. Essentials of Psychological Testing . Second Edition . 
New YorlTi Harper & Row Publishers, 1949, 1960. 



J 



Harcourt, Brace & World, Inc., Test Department. Test Service Notebook 
Number 13 . New York: Harcourt, Brace & World, Inc . , (no 

publication date given). \ 

Wood, D.A. Test construction. Development and interpretation of 

achievement test^ Columbus, Ohiol Charles E. Merrill Books, 
Inc., 1961. \ 



Other Topics 

Berg, I. Education A jobs: The great training robbery . New York: 

Beacon l-ress, 1970. 

Buckley, W.F. (Ed.) Modern systems research for the behavioral sc.ciitist: 
A sourcebooF I Chicago': Aldine PubliSh^g Co., 1968. 

Dewey, J. How we think . Boston: D.C. Heath & Co., 1910. 

Dillman, F.E., Jr. Instructional Objectives: Specificity and Behavior . 

Menlo Park, California: Dillman Associates, 1971. . 

Flanagan, J.C., Davis, F.B., Dailey, J.F., Shaycoft, M.F., Orr, D.’B., 
Goldberg, I., & Neyman, C.A., Jr. The American hiqh-sghool 
student . Final report for Cooperative Researd;i Project. No. 635, 
U.S. Office of Education, Department of Heal thi Education, and 
Welfare. Pittsburgb^^^roject TALENT Office and University 
of Pittsburgh, 1964.' 1 

. ^ ' i 

Flanagan, J.C., Shaycoft, M.F., Richards, J.M., Jr., & CTaudy, J.G. 

Five years after high school. Final report prepared under 
Grant No. 0EG-0-9-610065-l367(085) . Submitted to U.S. Office 
of Education, U.S. Department of Health, Education, and 
Welfare. Palo Alto, California; American Instlitutes for 
Research and University of Pittsburgh. 

The Foundation ‘Directory: Third Edition . New York: Russell Sage 

Foundation, 1967. 

Lansky, L.M. & Rebelsky, F.G. Edge-punched cards: A method for storing 

and retrieving social science references. Psychological 
Reports , 1963, J_3, 51-62. • 

Mager, R.F. Preparing Instructional Objectives . Palo Alto, California: 
Fearon Publishers, I^., 1962. 

Markle, S.M. Good frames and bad: A grammar of frame writing, 2nd 

edition. New York: John Wiley & Sons, Inc.,- 1969. 

Russell, B.R. Human knowledge; Its scope and limits . New York; 

Simoti and Schuster, 1948. 
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■/ 



Tiedemaji, D.V. & O'Hara, R,P. CareGr Development: Choice and adjustniGPt ^ 

New York: College Entrance Examination Board, 1963. 

Tiedeman, D.V. & Miller, A.L. An educating research machine game. 

Chapter for Education and the behavioral sciences . Rallo 
Handy (ED.) In press. 

U.S. Department of Health, Education, and Welfare, Office of Education/ 
National Center for Educational Communication. How to use ERIC. 
0E-12037-C Washington, D.C.: United States Government Printing 

Office, 1969. Revised 1970. 

U.S. Department of HeaTbli, Education, and Welfare, Office of Education/ 
Bureau of ReseVch. Computer-based vocational guidance system. 
OE-25053. Summary of papers presented at the Fourth Symposium 
, for Systems under Development for Vocational Guidance. 
Washington, D.C.: United States Government Printing-Office,. 
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appendix e 

\ 

SAMPLE OF LOG FORMAT 
LOG 



INCLUSIVE DATES: 

APPRENTICESHIP ACTIVITIES (What? For whom? When?): 

y 



AIR STAFF CONTACTS AND GENERAL PURPOSE OF MEETING: 



READINGS: (Please indicate whether related to (a) modulfes or other 

assignmehts, (b) apprenticeship activities, (c) personal 
follow-up on a topic of -interest) 



Author 



Title 



Source 




JOB SEARCH ACTIVITIES (sources identi 'lfed, resumes updated, letters sent-, 
interviews set. up, outcomes,. 'etc. ): 






TRANSFER SKILLS AND NEW SKILLS WHICH WOULD BE ATTRACTIVE AND USEFUL TO 
POTENTIAL EDUCATIONAL R&D EMPLOYERS: 



COMMENTS (e.g., suggestions- for program, accessi 



reactions to apprenticeship activities, etc;): 



bility of material^. 
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APPENDIX F, 



. SAMPLE OF LETTERS' FROM SUPERVISORS 
OF EXTERNAL APPRENTICESHIP 



X 




DEANZA 

COLLEGE 



f6othiu community 

COLLEGE DISTRICT 

* •' «./ 

21 ?SO SUv«ns Cr««K Btvd 
Cupertino - 
C«tilorn(«gaQM 
(408)257-5550 



September 22, 1971 



dr. Eugene Mlllslcin 
American Institutes for Research 
P. O. Box 1113 
Palo Alto, Califqrnla 9-i?j2 

Dear Dr. Mlllslein: 







In accordance wlth^ur conver^atfoTr^sjm^ is to advise you that Mike Ausloos is 
assigned to work with Florin Caldwell, Director of Institutional '"Re search at De Anza 
College, on a supervised apprenticeship basis, for tli,c period of-September 22, 1971 
to December, 15, 1971. 

■»* 

The apprenticeship will include professional supervision, work experience, provision 
for office/work space, access to the library,' and other instructional materials, use 
of research facilities and equipment, staff consultation, . and limited 'clerical assistance. 

During Mr. Ausloos* apprenticeship period, I see four major areas oi concentration 
which should take up most of his assigned time: 

1. - To write and implement a proposal to the Luke 3. Hancock Foundation for 

developing educational programs in Environmental Education in the Sunnyvale 
Elementary School District and in the San Jose Unifed School District. 

2. To develop the curriculum for an in-service training workshop for elementary 
school teachers in the area of Environmental Education and an in-service 
workshop for teachers in the use of compulrvs to help solve environmental 
problems. 

3. " To complete a proposal to the United States Department of Health, Education, 

and Welfare under the Environmental Education Act of 1970 (Public Law 91-516) 
which would provide for a state-wide program of in-service Environmental 
Education for elementary school teachers, -p 

4. Tp. become knowledgeable in the area of ’’Grantsmanship” and particularly 
In the areas of funding evaluations of on-going educational programs. 




Since 



fijQy 




A. Robert DeHart 
President 



ARD:e 
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Foothill 
and 
De Anzo 
Colleges 



FOOTHILL JUNIOR COLLLGE DISTRICT 

12345 EL MONTE ROAD • LOS ALTOS HILLS, CALIFORNIA 94022 • TELEPHONE (4151948-8590 



) 






November. 12, 1971 



Dr, Eugene Mills tein , ‘ . 

American Institute for Rbsearch ^ 

,P. 0. Box 1113 

Palo Alto, California 94302 
INTERN PROJECT 

Confirming our phone conversation this is to advise that we are 
'delighted to have your trainees, Neil Mattson and Bonita Berger 
assigryed to the Foothill Community College District on a supervised 
apprenticeship project from November, 1 to mid December. 

As you are aware, they are reviewing and up-dating the District *s 
five year plan. This involves not only an accurate analysis of 
recently available historical data but, more important in my mind, 
a fresh and objective professional consideration of our premises 
and formulas for projection. ^It is my hope to get a meld of the 
traditional academic approach and the contempor^y industrial 
methods . « ^ 

Obviously, .this project had and will continue to involve rof essional 
supervision on my part, the District Controller, our Director of 
Institutional Redearclj and others of our staff. They have had \iora- 
plete access to lOur r^cor^fe and past studies as well as any staff 
resources needed for consultation. We have assigned them an office 
wherj? they are free to accumulate and organize material for access 
as their schedule requires. 



We feel that this approach to the assignment, will give them a valuable 
. insj^ght to the hifeher-^eiiMCalioii, mil icu while providi.ig the D is trie g 
'^^pijoduct which 




therwisc not be available to us. 






Willi^^ B. Cutler 
Director^. Business Services 

WBC ; cm 






, ERIC 
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APPENDIX G 




CLASSIFIED ADVERTISEMENT 



380 Men, Women Wanted 



ARE^YOU AN 
1 UNEMPLOYED- 
AEROSPACE WORKER? 



Nofvord^tl •ducoTtOAOl reMorch 
Institute In the Sor Froncisco 
■^Boy area will conduct a small, 
pilot progrom ts hetp o limited 
number et mole ond temole cero- 
space workers Into the field of 
educotionol research and devei' 
opment. The- l^week progrom 
will K'chide apprenticeship work 
on prolK^i ond study of selected 
topics ond K^eblems In educotlon • 

such oe prodb'rt evoluotlon, curri. f 

cukim oevelucment, doto onoiy. 

, sis. etc. Assistvince in lob ploce ' 
meht provided. Appficonts must 
hove BS or BA w>d be wllilng to 
temporarUy relo^'ote in $F oreo. 
Tronsportotlen costs* ilvtng ex* 
pense stipend, ond allowonce tor 
dependonts offered. For further 
inforntotion coll 543-1014. Univer. . > 

sity of Washington* August 15. 16. . * 

or 17, 8 o. m. to 4;30 p. m. 




18 eiir c>raniraimrs 

Sunday, August 15, 1971 
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APPENDIX H 



PRESS RELEASE AND NEWSPAPER ARTICLES 



FROM: 



Eugene .Mi 11 stein 

American Institutes for Research 
P.O.\ Box. 1113 

Palo Alto, Ca-lifornia 94302 
(415) 328-3550 ! 



Augu§.t 10, 1971 



FOR RELEASE: August 13, 1971 



UNEMPLOYED, AEROSPACE PROFESSIONALS TO 
WORK IN EDUCATIONAL RESEARCH 



A new program to assist male and female unemployed a'erospace professionals 
shift to work in the field of educatioi(( is being developed in Palo Altp,, Calif- 
ornia. -The program is an experimentai"*tf>fort limited to a small number of 
aerospace workers from the Seattle and San Francisco Bay areas. It will be a 
13 week work-study program located at an educational researc.h institution. 
Trainees will study the field of education and concentrate on redirecting their 
own particular skills toward educational problems. ( ' ■ . 

The developers of the program feel^hat aerospace professionals can be of 
great value in the solution of educational problems. Technical skills in the 



areas of research design, systems analysis, and data processing have particular 



value in educational researclji. The trainees will work on such tasks as develop- 
ing"' new iMrning materials, ^^aluating tiie effectiveness of educational projects 
and product^ performing background research on programs such as' Sesam'e Street, 
and assisting school administrators in making systematic decisions. The demand 
for professionals in this area 'is expected to grow Qut;i<ng the coming decades. 

The American Institutes for Research is developing the program under a 
grant from the U.S. Office of .Education. The. program will run from SeptemUer ]5 

•to December 15, 1971., Trainees will spend mornings study-'ing selected topics and 

« ■ 

problems in education. They will spend afternoons as staff apprentices on 
appl ied research projects. The. tf-ainees 'accep.ted for the program must be wjTling 
•-to' relocate in the San Francisco area for a per.iod or approximately 13 weeks.' , 
A travel and ljvir\g allowance will be provided. The trainees, will also be given 
assistance' in locating appi^op'ri ate job openings i„n the field^ of education. 
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.If this experiment is s.uccessful, plans for an expanded program 1,'' a 
variety of settings will be considered. Designers of the program hope it 
will serve as an example of how physical sciencg 'skil Is' may be directed to 
solve some oP, our contemporary social problems. ' 
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Aerospace jobless 



Training slated 
in education 



A program to help unem- 
ployed aerospace professionals 
train for work in the field of ed- 
ucation wili start Sept. 15 at* the 
“Wltrican Institutes for Ro-'J 
search, an educational research 
institution in Pain Alto. 

The program, for a small 



number o' men and’^' women 



aerospace workers from the 
Bay Area and Seattle, will be a 
13-week combmntion work-study 
course. \ ^ 

Trainees .wi!* study the field 
of education asd concentrate on 
redirecting their own skills, lo- 
v;ard educational problems. 

Technical skills' in the areqs 
of research , design, systems 
analysis, and data processing 
are expected to have particular 
application. Trainees will de- 
velop new learning materials, 
evaluate educational projQcts 
and products, perform back- 
ground research on programs, 
and assist school administrators 



in making systematic d^isions. 
The American Institutes for 






Re^arch is developing the pro- 
gram under a grant from the 
U.S, Office of Education. Train- 
ees are to be given help in 
locating job openings in educa* 
itpn. as well as travel and liv- 
ing allowances. / 






Sunday, Augujf 15. 1971 



Shi' 
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About 20 Sealtl^ arc^ un 
employed aerospace ^rkei> 
will be selected ,^’or , pilot 
program being develo >ed by 
the American Institlf! js for 
Research at Falo Alto Calif. 

Tlie 13-week worl -study 
program will concentr ite on 
redirecting the skills oraero- 
spac^ professionals toward 
educational problems. • 

Applications may be ob- 
tained* at the .Educ-uional 
Foundation. 201 Miller Hall. 
Universify of VVashmgton 
.Application.s will be received 
through* Saturday and Candi- 
da te.s will be .notitied^hp Spe- 
lembcr 1 

Persons applying .ire rc 
qnired to have a bachelor of 
irts or » scitMKC degrees^. 
1 and living allowances 
will be provided. Trainees 
uill /receive assistance in 
finding jo';s at the end of the 
/ns. 
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APPENDIX I 

CONTENT OF FACT BOOKLET 



A ProQram to Praporo Unomployod Aorotpoco Workort 

for 

Jobs in Educational Rotoorch and Dovolopmont 



QUESTIONS AND ANSWERS FOR APPLICANTS 



AMERICAN INSTITUTES FOR RESEARCH 
Pott Offico Box 1113 / Palo Alto, Californio 94302 
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WHAT IS THE PURPOSE OF THIS PROGRAM? 



There are many male and female unemployed aerospace workers whose 
skills and talents are being lost by society. One solution to 
this problem Is to redeploy these skills from problem solving In 
the physical sciences to problem solving In the social sciences. 
This program Is designed to help aerospace workers transfer their 
scientific research and development skills to the field of educa- 
tion through a short-term apprenticeship work-study program. At 
the present time, the program Is viewed as a pilot study of the 
feasibility of this approach. Only a small number of trainees 
will be selected. If the pilot study Is successful, plans for 
an expanded program will be considered. 

WHO ARE THE SPONSORS OF THE PROGRAM ? 

The design of the program and responsibility for Its administration 
lie with the American Institutes for Research In Its Palo Alto, 
California office. AIR Is a private non-profit educational and 
scientific research Institution engaged In research and service 
In the behavioral, social, and educational science areas. Over 
the years, AIR has completed more than 800 projects In education 
and the behavioral sciences. The 450 persons employed by AIR In 
Its 5 locations Include researchers, technical staff, adminis- 
trative and clerical personnel, and other support staff. Approxi- 
mately 100 of the employees are senior scientists who hold doc- 
toral degrees In education, psychology, sociology, statistics, 
engineering, and other areas of the physical and social sciences. 

Financial support' Is provided through a grant from the Division of 
Research and Development Resources, National Center for Educational 
Research and Development, United States Office of Education. 
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WHERE WILL I BE TRAINED? 

Most of the training experiences will take place at AIR in Palo 
Alto, where office space, instructional materials, and staff 
will be located. Field trips and some experiences at other edu- 
cational research and. development institutions are scheduled. 

WHEN DOES THIS PROGRAM START AND HOW LONG DOES IT LAST ? 

Trainees will begin the apprenticeship work-study program on 
Wednesday, September 15, 1971. The program will run 13 weeks, 
terminating on Wednesday, December 15, 1971. The normal work day 
is from 8:30 am to 5:00 pm. Trainees may also expect to spend 
some after- time hours in directed study, personal research projects, 
and the like. 

WHAT WILL THE TRAINING INVOLVE? 

Instructional experiences will inelude seminars, directed inde- 
pendent studies, and specific project apprenticeships. Morning 
sessions will be devoted to formal seminars and independent study. 
Afternoons will be devoted to apprenticeship work. Instruction 
will be handled by various AIR staff members and will be tailored 
to the particular needs of the individual trainees. Visiting 
speakers will also be invited to participate in the seminars. 

The following general subject areas will be covered: 

1) Orientation to Education and Educational Problems . This 
area is designed to introduce the trainee to the basic educa- 
tional setting. Trainees will talk with teachers and adminis- 
trators, view videotapes of schools in action, and make field 
trips to schools. They will become familiar with the struc- 
. ture and administration of public schools and the legal, social, 
and political constraints within which they operate. Educa- 
tional problems including learning and classroom management 
will be covered. 
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2) Introduction to Educational Research and Development . 

This will be an overview of the major topics, efforts, and 
activities in educational research and development. The content 
will include such topics as learning theory, evaluation, edu- 
cational technology, behavioral research methods and instru- 
mentation, and basic terminology. Field trips to other educa- 
tional research and development institutions will be included. 

3) Comparative Task and Skill Transfer Analysis . The objec- 
tive of this topic area is to compare and contrast the tasks 
and requisite skills of research and development in the physi- 
cal sciences with research and development in the behavioral 
sciences and particularly education. Areas of comparison might 
include settings, problem arias, organization and administra- 
tion, and approach to problem solving. A good deal of this 
content depends heavily on the trainees themselves. The com- 
parison will serve to highlight those, areas in educational research 
in which they are already competent and to point out task and 
skill areas in which trainees need more familiarization or 

study. These identifications will be particularly valuable 
in defining individual objectives for each person in the 
training program. 

4) Requisite Skills Development . Thii, area will be treated 
through formal sub-group seminars whenever trainee needs co- 
incide. Typically, however, directed independent studies will 
be more appropriate. Special problems or topics will be trainee 
electives. Decisions will be based on their existing skills, 
the conclusions of the formal sessions on comparative task 
a'^alysis, and the nature of their project apprenticeship and 
interests. The number of individually treated topics will 
depend on all of these factors, plus the intensity with which 

a trainee wishes to pursue a topic. 





* 






While the total pool of topics will evolve and finalize as the 
work-study program progresses into its third and fourth weeks, 
the pool would probably include: a) systems analysis, planning 

and control techniques (e.g., PERT, PPBS)i; b) data processing; 



c) educational statistics and data analys 
organization, and presentation; e) instru 



is ; d) data collection, 



Liment <^velopment, 
questionnaire design, standardized testing; f) material pro- 
duction and distribution; g) field testirig; h) sampling; i) re- 
search report writing; j) scaling; and k)^ educational informa- 
tion retrieval (e.g., ERIC system). 



5) Job Prospects and Career Development Strategies . This area 
will include a summary of employment opportunities. The various 
settings in which educational R & D takes place will be analyzed. 
Long range career plans will be discussed. Proposal writing 
and project funding will also be covered. 



A number of sessions of formal instruction toward the end of 
the three month program will be devoted to the format, art, 
and technique of proposal writing. Trainees will examine and 
discuss a variety of proposal types and topics. During this 
time each trainee will actually write proposals. 



I 



Discussions in the area of project funding will include: 1) a 

survey of education?.! R&D sponsors, 2) the system of contacts and 
contracts, and 3) project type or topic and logical funding sources. 



Topics 1, 2 , 3, and 5 will be covered in formal seminars. Topic 4 will 
be covered primarily in the directed independent study. Although 
instruction will be largely sequential, frequent overlap and review 
will occur. Learning in all five areas will be reinforced in the 
project apprenticeship. During the apprenticeship, trainees initially 
will survey a large number of ongoing projects; th'ey will receive 
specially prescribed project experience, and then engage in project 
work based on their own interests. 
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WHAT KIND OF BACKGROUND MUST I HAVE TO BE ELIGIBLE? 



To apply for the training program, an applicant must be an unemployed 

aerospace worker who holds a B S. or B. A. degree. For survey 

purposes, the application form will include questions on routine 

demographic data on such factors as age, sex, and marital status. 

In no way whatsoever, will this information be used to influence 
» 

eligibility or selection. Individuals of all ages, sex, and 
ethnic backgrounds are encouraged to apply. 

HOW WILL TRAINEE SELECTION BE MAD E? 

Selection will be based on a written application, a test of general 
knowledge of selected topics in education, academic ability, and 
work history and experience. Relevant experiences which indicate 
interest in the field of education and the possibility of interest 
in a long range career commitment are desirable. 

WILL I BE PAID DURING TRAINING? 

Trainees will receive a stipend of $75 per week for the 13 weeks 
of the program. Tn addition, support for dependents will be pro- 
vided at the rate of $15 per week per dependent for 13 weeks. 

For trainees from out of state, transportation costs equivalent 
to one round trip air fare per trainee will be provided. 

DO I PAY INCOME TAX ON MY STIPEND? 

No 



er|c 



- 96 - 



WHAT KINDS OF ACTIVITIES ARR INVOLVED IN EDUCATIONAL RESEARCH AND 

UEVLLOPMENT? 

Educational R & D occurs in a variety of institutions including 
federally sponsored centers and laboratories, profit and non- 
profit research organizations, private corporations, school systems, 
federal and state departments of education , and publishing com- 
panies. There are a broad range of activities. Examples include 
developing new learning materials, evaluating the effectiveness of 
educational projects and products, performing background research 
on programs such as Sesame Street, designing scheduling systems 
for big city schools, and assisting educational administrators in 
making systematic decisions. 

WILL I BE GUARANTEED A JOB? 

No. Job placement is not guaranteed. However, a recent manpower 
needs study in the Bay Area has suggested the need for educational 
research and development workers. AIR will make preliminary contact 
with potential employers, assist trainees in making personal contacts 
and job inquiries, and assist in interview arrangements. 

In addition, contact will be maintained with California's Human 
Resources Development Agency, the Department of Labor's Manpower 
Administration, and other agencies active in implementing the ad- 
ministration's new aid program for the unemployed. Under this 
program, funds are made available to assist the jobless in investi- 
gating job possibilities away from home, cover moving costs necessitated 
by job changes, and underwrite on-the-job training. 

WHAT KIND OF JOB RESPONSIBILITIES AND SALARY CAN I EXPECT IF I AM 

SUCCESSFUL IN FUTURE JOB PLACEMENT? 

Traipses who successfully locate jobs in educational R & D cannot 
expect to enter the .'ield at the same high levels of responsibility 
or salary which were arobably typical of their employment in the 
aerospace industry. Entry level salaries of R & D personnel with 
a B.S. or B.A. and some experience might be as low as $8,000 to 
$12,000. Additional degrees, specific technical skills, such as 



data processing skills and/or a base of related experience could 
raise these figures by as much as $4,000. 

The entry level professional is likely to have some opportunity 
of responsibility for his own work, but is unlikely to be autono- 
mous in final decision-making. The field has significant advance- 
ment opportunity potential and on-the-job development opportunity. 

As in any industry, experience and demonstrated competency are 
reflected in increased staff and decision-making responsibilities. 

WHERE ARE EDUCATIONAL R & D JOBS LOCATED? 

Jobs are likely to be located in or near large urban areas which are 
major commercial and educational centers for their region of the 
country. 

WHAT ARRANGEMENTS WILL BE MADE FOR LIVING ACCOMMODATIONS DURING 
TRAINING? 

Arrangements for special motel rates will be made by AIR for those 
trainees so desiring. Rates can be obtained for approximately $5 
per day per person with double occupancy. Others may wish to rent 
a room, apartment or house, or defray living expenses by sharing 
facilities with other trainees. Furnished studio apartments in 
the area start at approximately $125 per month; furnished one 
bedroom apartments start at approximately $145, while furnished 
two bedroom apartments and modest houses are unlikely to start at 
less than $180 per month. The costs of these arrangements will 
be the trainee's responsibility. 

« 

WILL I NEED A CAR? 

Some personal transportation will be essential. AIR is located in 
the foothills overlooking Stanford University and is not near public 
transportation. A car pool with other trainees might be considered, 
but the trainee might wish more Independence in his mobility. All 
transportation expenses while in the area are borne by the trainee. 



WHAT PROVISION WILL BE. M/DE FOR MY HOUSEHOLD AND FAMILY? 



No specific benefits for the households and families of trainees 
other than the $15 per week per dependent allowance are available 






APPENDIX J 



COPY OF REJECTION LETTER* 



Dear Mr. 

We appreciate your application to our program to prepare unemployed 
aerospace workers for jobs in educational research and development. 
Unfortunately, there were many applications and only a limited number of 
spaces available. We very much regret our inability to invite you to 
join the program. It should be emphasized that a large number of highly 

qualified applicants had to be turned away solely because of a lack of 
space. 

I would personally like to wish you the best of luck in finding a 
job commensurate with your abilities and interests. 

Sincerely, 



Eugene J. Mi 11 stein 
Project Director \ 



iky 
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APPENDIX K 

COPY OF REJECTION LETTER FOR FINALISTS 



© 




Dear Mr. 

I 

With a great deal of regret I must inform you that we are unable 
to invite you to join our training program; Your application did rank 
near the very top in a field of more than 100 applicants. Unfortunately, 
there were very few spaces available. Much to our dismay we have had 
to turn down several highly qualified applicants such as yourself sblely 
because of a lack of space. 



I'd like to thank you for taking the trouble to come down to the 
University and I certainly wish you the best of luck in finding a job 
comnensurate with your considerable qualifications. 



Sincerely, 




Eugene J. Mill stein 
Project Director 



iky 



A 







- 101 - 

1 . : 




I 









‘ APPENDIX L 

STATEMENT ON NUMBER OF DEPENDENTS 



TO: Eugene Mill stein 

FROM: 

DATE: 

This is to inform you that I have dependents 

(not including myself). Dependent is taken as defined by the 
Internal Revenue Service. 



Q. 



\ 



I ^ 
; ) 

I' 



signature 



Date 





f 




/ 
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APPENDIX M 



STATEMENT ON TRAVEL ALLOWANCE 



I hereby formally accept enrollment in the American Institutes 
for Research program to cross-train aerospace professionals for work 
in educational research and development. In the event that I leave 
the program early, for reasons other than health, extreme family 
hardship, or acceptance of a job in educational research and develop 
mentj, I agree to return a portion of the ^advanced travel allowance 
not to exceed a proportion prorated on the length of attendance at 
the Institute, ( 

f 

\ 



signature 



APPENDIX N 



EXAMPLE OF EMPLOYMENT INQUIRY LETTER 



November 22, 1971 



Dear Dr. 



Dr. Dunn suggested I write to you with regard to several physical 
scientists who are seeking Jobs in educational R&D. These people are 
participating in a three-month AIR program designed to help them extend 
their skills into the field of educational R&D. Their sk-lls include 
expertise in systems analysis, statistical techniques, computer program- 
ming, report writing, proposal development, etc. The program has been 
quite successful; all participants have worked effectively and made im- 
portant contributions to ongoing AIR projects. In general, participants 
have the combination of experience and training in educational research 
in addition to a broad background and extensive experience in engineering 
and the physical sciences. I might add that of the more than 170 ^ 
gineers and scientists who applied to the program, the six partici^nts 
were selected because they possessed special skills and interests very 
useful in educational R&D.. 

I am enclosing the resumes of two of the participants who are from 
the Northwest. Both are quite flexible about position and salary. 

Please let us know if you wish to talk with any of them about employment. 
There is a possibility thatfederal funds administered through the states 
of California or< Washington will pay for an applicant's interview trip. 

In addition there is a federal program administered through the states 
which is designed to help unemployed defense workers ihift to new indus- 
tries. Thus it is possible, depending on specific job definitions, that 
up to $2,000 of new employee's salary would be subsidized. 

Thank you. 



Sincerel) 




Eugene J. Mi 11 stein 
Project ^Director 



iky 
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APPENDIX 0 



ORGANIZATIONS TO WHICH EMPLOYMENT 
INQUIRIES WERE MADE 

r 



Inquiries were made both in person and by mail. This list includes 
organizations contacted by trainees themselves and organizations con- 
tacted by AIR staff members on behalf of trainees. 

Educational Research and Development Companies and Institutes (profit 
and non-profit) 

Education Engineering Associates 
Educational Development Corporation 
Educational Testing Service 
HumRRO 
McGraw-Hill 

Science Research Associates 
Stanford Research Institute 
Technica Education Systems 
Westinghouse Learning Corporation 

Other Companies 

Lockheed (Human Factors) 

Sylvania (Socio-Systems) 

United California Bank (Training Director) 

Regional Laboratories and Centers 
Regional Laboratories and Centers 

Arizona Center for Early Childhood Education 

Center for Vocational and Technical Education (Ohio State 
University) 

Far West Laboratory for Educational [Research and Development ^ 
Northwest Regional Educational Laboratory 

V 







States and Counties 



California Advisory Council for anUechn ical Training 

Santa Clara County Center for Planning and ‘ 

South Dakota Department of Public Instruction 
Wisconsin State Department of Public Instruction 



Universities and CollPf^pg 

DeAnza Community College 
Foothill Community College District 
Gavilan Community College 
Stanford University 
University of Virginia 

University of Washington, School of Education 



ERIC Clearinghouse 

SEP2 1 1972 

on Adult fidocatiiM 



